00000001:02000400:2.0F:1788448140.471335:0:3301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_hostid 00000001:02000400:2.0:1788448162.706307:0:3522:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788448165.118949:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 671 MB/s 00000001:01000000:2.0:1788448165.369103:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 799 MB/s 00000001:01000000:3.0:1788448165.620071:0:3565:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2565 MB/s 00000020:02000000:0.0F:1788448166.689622:0:3614:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g02cdcd5 00000400:02000000:2.0:1788448168.036717:0:3629:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.121@tcp [8/256/0/180] 00008000:02000000:3.0:1788448171.828123:0:3777:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788448227.135932:0:5744:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000020:01000004:1.0F:1788448239.524821:0:6494:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788448239.524839:0:6494:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788448239.524841:0:6494:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788448239.525010:0:6494:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000faca2b9c 00000080:02000400:1.0:1788448239.525022:0:6494:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788448239.533388:0:6494:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788448239.533412:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788448239.535002:0:6494:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000fa34a731) 00000020:00000080:0.0:1788448239.535030:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448239.589070:0:6494:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788448239.589160:0:6494:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788448239.610843:0:6494:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788448239.612048:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788448239.612060:0:6494:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788448239.612075:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8031eb 00000020:01000004:0.0:1788448239.612084:0:6494:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788448239.612090:0:6494:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788448239.612096:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000faca2b9c from MGS 00000020:01000004:0.0:1788448239.612101:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788448239.612115:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000be1bd167) 00000020:00000080:0.0:1788448239.612125:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788448239.612198:0:6494:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000faca2b9c from MGS, refs=2 00080000:01000000:0.0:1788448239.612204:0:6494:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788448239.612208:0:6494:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8031f9 00000100:00100000:0.0:1788448239.613295:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788448239.613792:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788448239.613800:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788448239.616293:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788448239.616306:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788448239.621248:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448239.621529:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788448239.621537:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788448239.623072:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788448239.623086:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788448239.624146:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788448239.624158:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788448239.625154:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448239.625160:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448239.625162:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448239.625447:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448239.625450:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448239.625451:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448239.626117:0:6494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788448239.630345:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788448239.876036:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3047 MB/s 00000001:01000000:1.0:1788448240.126117:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3507 MB/s 00000001:01000000:3.0:1788448240.379845:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 747 MB/s 00000001:01000000:3.0:1788448240.630511:0:6494:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 752 MB/s 00080000:10000000:3.0:1788448240.636573:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:2.0:1788448240.638233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788448240.653248:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1788448240.654435:0:6508:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788448240.654510:0:6494:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788448240.654567:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788448240.654798:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788448240.654822:0:6494:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788448240.655253:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448240.655486:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788448240.655495:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788448240.663349:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788448240.663367:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788448240.663737:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788448240.663744:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1788448240.670495:0:6513:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788448240.670557:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788448240.670584:0:6494:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.121@tcp' 00000020:01000004:3.0:1788448240.670586:0:6494:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788448240.670649:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.121@tcp (typ=mgc) 00000020:00000080:3.0:1788448240.670673:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.121@tcp (00000000079d7ec7) 00000020:00000080:3.0:1788448240.670698:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788448240.672779:0:6494:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fc172416@MGC192.168.206.121@tcp: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448240.672985:0:6494:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.121@tcp-0 is initialized 00000040:01000000:3.0:1788448240.673006:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788448240.675676:0:6514:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788448240.675786:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.121@tcp (uuid 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb) 00000020:00000080:0.0:1788448240.675815:0:6494:0:(genops.c:1385:class_connect()) connect: client 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb, cookie 0xf45a9e4e6b803207 00000100:00080000:0.0:1788448240.675830:0:6494:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448240.675837:0:6494:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import 00000000fc172416 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448240.676402:0:6494:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003961930d x1875323826208896/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448240.676432:0:6494:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS 00000020:01000004:0.0:1788448240.676459:0:6494:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788448240.676466:0:6494:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788448240.677145:0:6494:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000003f55c234) 00000020:00000080:0.0:1788448240.677169:0:6494:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788448240.677701:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003961930d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826208896:0@lo:250: 00000100:00100000:3.0:1788448240.677818:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448240.677937:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826208896 00000100:00100000:1.0:1788448240.677949:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826208896 00000100:00100000:1.0:1788448240.678004:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448240.678013:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007802b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1875323826208896:12345-0@lo:250: 00010000:00080000:1.0:1788448240.678042:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:1.0:1788448240.678068:0:6509:0:(genops.c:1385:class_connect()) connect: client 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb, cookie 0xf45a9e4e6b803215 00000100:00080000:1.0:1788448240.678213:0:6509:0:(import.c:65:import_set_state_nolock()) 00000000f97e7e1a : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448240.678285:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007802b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:3644:x1875323826208896:12345-0@lo:250: Request processed in 271us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448240.678293:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448240.678580:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788448240.678592:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.121@tcp: connect to target with instance 0 00000100:00080000:3.0:1788448240.678600:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788448240.678607:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788448240.678610:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000fc172416 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788448240.678613:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788448240.682372:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788448240.682479:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003961930d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826208896:0@lo:250: 00000100:00100000:0.0:1788448240.695927:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448240.696288:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788448240.696296:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788448240.702254:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448240.702270:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788448240.703877:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448240.703952:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788448240.706653:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448240.706868:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788448240.707169:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788448240.708110:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788448240.708121:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788448240.744457:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448240.745067:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788448240.745548:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788448240.748609:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788448240.748628:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788448240.749871:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448240.750130:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788448240.750136:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788448240.750949:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788448240.750958:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788448240.751669:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448240.751865:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788448240.751871:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788448240.753964:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788448240.753980:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788448240.754871:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448240.755121:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788448240.755127:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788448240.756793:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788448240.756806:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788448240.781359:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448240.782643:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788448240.782655:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788448240.789593:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788448240.789615:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788448240.791140:0:6494:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788448240.791156:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788448240.794010:0:6494:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788448240.794056:0:6494:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788448240.794077:0:6494:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788448240.794223:0:6494:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788448240.794267:0:6494:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788448240.794273:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788448240.794275:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788448240.794277:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448240.794278:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448240.794280:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448240.794282:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448240.794283:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448240.794285:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788448240.794287:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448240.794288:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448240.794290:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448240.794292:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448240.794295:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788448240.794298:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448240.794299:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788448240.794300:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448240.794301:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448240.794302:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448240.794303:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448240.794304:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448240.794305:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788448240.794306:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448240.794307:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448240.794308:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448240.794309:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448240.794362:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788448240.794395:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209024:0@lo:253: 00000100:00100000:3.0:1788448240.794824:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448240.795026:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cf1add46 going to sleep for 11 seconds 00000100:00100000:2.0:1788448240.798183:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209024 00000100:00100000:2.0:1788448240.798208:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209024 00000100:00100000:2.0:1788448240.798372:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448240.798404:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ff9a54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6494:x1875323826209024:12345-0@lo:253: 20000000:01000000:2.0:1788448240.798668:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788448240.798672:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788448240.799258:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788448240.799332:0:6511:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788448240.799864:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448240.803121:0:6534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1788448240.803453:0:6511:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788448240.803458:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1788448240.803465:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1788448240.803537:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1788448240.803554:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1788448240.804142:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448240.807287:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1788448240.807334:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788448240.807378:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1788448240.807410:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1788448240.807430:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1788448240.808345:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1788448240.808364:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1788448240.809044:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1788448240.809058:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1788448240.809075:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1788448240.809081:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1788448240.809095:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1788448240.809112:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1788448240.809174:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788448240.809182:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1788448240.809191:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448240.809401:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1788448240.809414:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788448240.809432:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1788448240.809448:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1788448240.809460:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1788448240.810861:0:6511:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1788448240.811382:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1788448240.811409:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788448240.811427:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1788448240.811443:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1788448240.811457:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1788448240.811466:0:6511:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1788448240.811506:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1788448240.811514:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1788448240.811528:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1788448240.811542:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1788448240.811634:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1788448240.811661:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788448240.811671:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788448240.812493:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788448240.812813:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788448240.812846:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.121@tcp for mdt 20000000:01000000:3.0:1788448240.812849:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:3.0:1788448240.812867:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788448240.812918:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788448240.812938:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788448240.812944:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:3.0:1788448240.812959:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788448240.812967:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788448240.812980:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788448240.812997:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788448240.813035:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788448240.813038:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788448240.813043:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788448240.813195:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788448240.813198:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788448240.813810:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788448240.814141:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788448240.814170:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788448240.814200:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788448240.814212:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788448240.814214:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788448240.814666:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788448240.814948:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788448240.814982:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788448240.814999:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788448240.815017:0:6511:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448240.815020:0:6511:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788448240.815025:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788448240.815028:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788448240.815033:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788448240.815041:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788448240.815770:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788448240.816079:0:6511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788448240.825148:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1788448240.825715:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1788448240.825740:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1788448240.825793:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788448240.825824:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825846:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825857:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825924:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825931:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825939:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825945:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a0de57c0 already unused, calling callback (00000000eede70fe) 00010000:00010000:3.0:1788448240.825949:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825958:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825971:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825978:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.825984:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80321c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788448240.826005:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788448240.840281:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ff9a54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6494:x1875323826209024:12345-0@lo:253: Request processed in 41882us (45446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448240.840310:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448240.840446:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209024:0@lo:253: 10000000:01000000:0.0:1788448240.840477:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788448240.840482:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448240.840484:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448240.840485:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448240.840487:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1788448240.840488:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448240.840490:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448240.840492:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448240.840493:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448240.840495:0:6494:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788448240.840496:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448240.840498:0:6494:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788448240.840528:0:6494:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000faca2b9c from lustre-MDT0000 10000000:01000000:0.0:1788448240.840567:0:6494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788448240.840570:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788448240.840575:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fc19ebe99b8 10000000:01000000:0.0:1788448240.840581:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448240.840590:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc19ebe99b8 from 1 10000000:01000000:0.0:1788448240.840593:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788448240.840638:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448240.840651:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448240.840683:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448240.840704:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209152:0@lo:101: 00000100:00100000:0.0:1788448240.840745:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448240.840804:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5680cbe going to sleep for 11 seconds 00000100:00100000:3.0:1788448240.840931:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209152 00000100:00100000:3.0:1788448240.840946:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209152 00000100:00100000:3.0:1788448240.840988:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448240.840997:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e536155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6494:x1875323826209152:12345-0@lo:101: 00010000:00010000:3.0:1788448240.841013:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448240.841026:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803223 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.841055:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.841066:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 6 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448240.841077:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0de57c0, rc 0) 00000100:00100000:3.0:1788448240.841110:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e536155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6494:x1875323826209152:12345-0@lo:101: Request processed in 115us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448240.841116:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448240.841378:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209152:0@lo:101: 00010000:00010000:0.0:1788448240.841406:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448240.841416:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448240.841489:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209280:0@lo:501: 00000100:00100000:0.0:1788448240.841519:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448240.841550:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5680cbe going to sleep for 11 seconds 00000100:00100000:3.0:1788448240.841649:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209280 00000100:00100000:3.0:1788448240.841654:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209280 00000100:00100000:3.0:1788448240.841690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448240.841697:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000982e05c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6494:x1875323826209280:12345-0@lo:501: 00000100:00100000:3.0:1788448240.841795:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000982e05c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6494:x1875323826209280:12345-0@lo:501: Request processed in 98us (276us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448240.841802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448240.841878:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209280:0@lo:501: 10000000:01000000:1.0:1788448240.841946:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788448240.841960:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.841968:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448240.841976:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc190ac6000 10000000:01000000:1.0:1788448240.841981:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788448240.841985:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc190ac6000 10000000:01000000:1.0:1788448240.841998:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788448240.842001:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc190ac6000 from 1 10000000:01000000:1.0:1788448240.842004:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788448240.842047:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842054:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842060:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448240.842072:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209408:0@lo:101: 00000100:00100000:1.0:1788448240.842105:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448240.842123:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b3d8d2 going to sleep for 11 seconds 00000100:00100000:1.0:1788448240.842141:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209408 00000100:00100000:1.0:1788448240.842146:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209408 00000100:00100000:1.0:1788448240.842169:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448240.842175:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874d44f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6494:x1875323826209408:12345-0@lo:101: 00010000:00010000:1.0:1788448240.842185:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448240.842197:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e90c4da9/0xf45a9e4e6b803238 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803231 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842215:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e90c4da9/0xf45a9e4e6b803238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803231 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842224:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e90c4da9/0xf45a9e4e6b803238 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803231 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842231:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e90c4da9, rc 0) 00000100:00100000:1.0:1788448240.842272:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874d44f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+7:6494:x1875323826209408:12345-0@lo:101: Request processed in 97us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448240.842277:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448240.842318:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209408:0@lo:101: 00010000:00010000:1.0:1788448240.842329:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842337:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448240.842348:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788448240.842351:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842357:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000940d7246/0xf45a9e4e6b803231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448240.842363:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788448240.842366:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448240.842370:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc190ac6000 10000000:01000000:1.0:1788448240.842373:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788448240.842375:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788448240.842377:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788448240.842398:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842405:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842413:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448240.842432:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209536:0@lo:101: 00000100:00100000:1.0:1788448240.842454:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448240.842479:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b3d8d2 going to sleep for 11 seconds 00000100:00100000:1.0:1788448240.842492:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209536 00000100:00100000:1.0:1788448240.842495:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209536 00000100:00100000:1.0:1788448240.842512:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448240.842516:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007718c0dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+7:6494:x1875323826209536:12345-0@lo:101: 00010000:00010000:1.0:1788448240.842522:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448240.842529:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80323f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842540:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842546:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842551:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000850820e9, rc 0) 00000100:00100000:1.0:1788448240.842577:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007718c0dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+8:6494:x1875323826209536:12345-0@lo:101: Request processed in 60us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448240.842582:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448240.842610:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209536:0@lo:101: 00010000:00010000:1.0:1788448240.842618:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448240.842624:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448240.842683:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209664:0@lo:501: 00000100:00100000:1.0:1788448240.842706:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448240.842718:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b3d8d2 going to sleep for 11 seconds 00000100:00100000:1.0:1788448240.842730:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209664 00000100:00100000:1.0:1788448240.842733:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209664 00000100:00100000:1.0:1788448240.842749:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448240.842754:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b152ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+8:6494:x1875323826209664:12345-0@lo:501: 00000100:00100000:1.0:1788448240.842863:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b152ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6494:x1875323826209664:12345-0@lo:501: Request processed in 109us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448240.842869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448240.842925:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209664:0@lo:501: 00000100:00100000:1.0:1788448240.842950:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209792:0@lo:503: 00000100:00100000:1.0:1788448240.842995:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448240.843007:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 0000000061b3d8d2 going to sleep for 11 seconds 00000100:00100000:1.0:1788448240.843018:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209792 00000100:00100000:1.0:1788448240.843021:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209792 00000100:00100000:1.0:1788448240.843036:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448240.843041:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f612eb7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6494:x1875323826209792:12345-0@lo:503: 00000100:00100000:1.0:1788448240.843120:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f612eb7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6494:x1875323826209792:12345-0@lo:503: Request processed in 78us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448240.843127:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448240.843166:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826209792:0@lo:503: 00000100:00100000:0.0:1788448240.856330:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d17f8b9c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6539:1875323826209920:0@lo:502: 00000100:00100000:0.0:1788448240.857117:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448240.857267:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 000000003638f92b going to sleep for 11 seconds 00000100:00100000:1.0:1788448240.860181:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826209920 00000100:00100000:1.0:1788448240.860202:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826209920 00000100:00100000:0.0:1788448240.864331:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448240.864349:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000278d96a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6539:x1875323826209920:12345-0@lo:502: 00000100:00100000:0.0:1788448240.864623:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000278d96a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6539:x1875323826209920:12345-0@lo:502: Request processed in 277us (7509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448240.864632:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448240.864752:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d17f8b9c pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6539:1875323826209920:0@lo:502: 00000020:01000000:1.0:1788448240.864794:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448240.864809:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448240.864812:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788448240.864818:0:6539:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788448240.864822:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448240.864844:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000cb5b6c9e) 00000020:00000080:1.0:1788448240.864867:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788448240.864875:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788448240.865054:0:6539:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788448240.865063:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b803254 00000020:00000080:1.0:1788448240.865330:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788448240.865335:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448240.865340:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448240.865341:0:6539:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788448240.865344:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448240.865348:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448240.865349:0:6539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788448240.865353:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448240.865362:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000018e4c24a) 00000020:00000080:1.0:1788448240.865372:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788448240.865377:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788448240.865379:0:6539:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788448240.865382:0:6539:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788448240.865401:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788448240.865470:0:6539:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000faca2b9c from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788448240.865484:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000fb5a4d5a) 00000020:00000080:1.0:1788448240.865493:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788448240.865578:0:6539:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788448240.865585:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b803269 00000020:00000080:1.0:1788448240.865718:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788448240.865725:0:6539:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788448240.865737:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf45a9e4e6b803270 00080000:01000000:1.0:1788448240.865744:0:6539:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788448240.865747:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b803277 00080000:10000000:1.0:1788448240.866460:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788448240.866632:0:6539:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788448240.882205:0:6539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788448240.985379:0:6539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1788448240.986156:0:6539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1788448240.989415:0:6539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788448240.990078:0:6539:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788448241.007344:0:6539:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000bdf508c1) 00000020:00000080:2.0:1788448241.007398:0:6539:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788448241.007488:0:6539:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788448241.007514:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b803285 00000020:00000080:2.0:1788448241.014734:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788448241.015686:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:1.0:1788448241.019526:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788448241.026080:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788448241.034767:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788448241.038665:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788448241.044790:0:6539:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788448241.047569:0:6539:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf45a9e4e6b80328c 00000020:00000080:3.0:1788448241.060016:0:6539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788448241.060038:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448241.060049:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448241.060052:0:6539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788448241.060058:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448241.060080:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448241.060082:0:6539:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788448241.060091:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788448241.060094:0:6539:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788448241.060100:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448241.060102:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448241.060103:0:6539:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788448241.060105:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448241.060110:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448241.060111:0:6539:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788448241.060115:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788448241.060196:0:6539:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788448241.060269:0:6539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006fe32ce5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6539:1875323826210048:0@lo:502: 00000100:00100000:3.0:1788448241.060370:0:6539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448241.060736:0:6539:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ed6e5a8 going to sleep for 11 seconds 00000100:00100000:0.0:1788448241.062560:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210048 00000100:00100000:0.0:1788448241.062603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210048 00000100:00100000:0.0:1788448241.062682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448241.062692:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a14dcd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6539:x1875323826210048:12345-0@lo:502: 00000100:00100000:0.0:1788448241.062957:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a14dcd74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6539:x1875323826210048:12345-0@lo:502: Request processed in 266us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448241.062966:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448241.063105:0:6539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006fe32ce5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6539:1875323826210048:0@lo:502: 00000020:01000000:1.0:1788448241.063146:0:6539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448241.063154:0:6539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448241.063157:0:6539:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788448241.063161:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788448241.064240:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788448241.064279:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788448241.064298:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.064311:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448241.064318:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc190ac6000 from 1 10000000:01000000:0.0:1788448241.064320:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448241.064361:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.064368:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.064377:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448241.064426:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210176:0@lo:101: 00000100:00100000:0.0:1788448241.064515:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.064575:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000009108d247 going to sleep for 11 seconds 00000100:00100000:1.0:1788448241.064717:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210176 00000100:00100000:1.0:1788448241.064726:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210176 00000100:00100000:1.0:1788448241.064772:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448241.064781:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000597d9d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:6494:x1875323826210176:12345-0@lo:101: 00010000:00010000:1.0:1788448241.064795:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448241.064809:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803293 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.064834:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.064843:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.064860:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e19b33a, rc 0) 00000100:00100000:1.0:1788448241.064949:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000597d9d62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:6494:x1875323826210176:12345-0@lo:101: Request processed in 168us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448241.064956:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448241.065716:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210176:0@lo:101: 00010000:00010000:0.0:1788448241.065754:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.065766:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448241.069961:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210304:0@lo:256: 00000100:00100000:1.0:1788448241.070068:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448241.070272:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000008449fdfa going to sleep for 11 seconds 00000100:00100000:3.0:1788448241.078150:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210304 00000100:00100000:3.0:1788448241.078176:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210304 00000100:00100000:3.0:1788448241.078944:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448241.078964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000295a83ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:6494:x1875323826210304:12345-0@lo:256: 20000000:01000000:3.0:1788448241.079000:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788448241.079006:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788448241.079194:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000295a83ad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:6494:x1875323826210304:12345-0@lo:256: Request processed in 237us (9127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448241.079202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448241.079341:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006de429a7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210304:0@lo:256: 10000000:01000000:0.0:1788448241.080051:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448241.080073:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.080087:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448241.080095:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc190ac6000 from 1 10000000:01000000:0.0:1788448241.080098:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448241.080141:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.080148:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.080158:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448241.080178:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210432:0@lo:101: 00000100:00100000:0.0:1788448241.080229:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.080897:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000009108d247 going to sleep for 11 seconds 00000100:00100000:1.0:1788448241.080999:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210432 00000100:00100000:1.0:1788448241.081009:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210432 00000100:00100000:1.0:1788448241.081060:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448241.081069:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071dfcf35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:6494:x1875323826210432:12345-0@lo:101: 00010000:00010000:1.0:1788448241.081175:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448241.081195:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8032a1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.081223:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.081235:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.081245:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a4fbf1c, rc 0) 00000100:00100000:1.0:1788448241.081431:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071dfcf35 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6494:x1875323826210432:12345-0@lo:101: Request processed in 363us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448241.081438:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448241.081705:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210432:0@lo:101: 00010000:00010000:0.0:1788448241.081743:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448241.081753:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448241.081834:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210560:0@lo:501: 00000100:00100000:0.0:1788448241.081870:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.085489:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000009108d247 going to sleep for 11 seconds 00000100:00100000:1.0:1788448241.085830:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210560 00000100:00100000:1.0:1788448241.085842:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210560 00000100:00100000:1.0:1788448241.085989:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448241.086000:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008eed9ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6494:x1875323826210560:12345-0@lo:501: 00000100:00100000:1.0:1788448241.086279:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008eed9ac6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6494:x1875323826210560:12345-0@lo:501: Request processed in 281us (4409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448241.086288:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448241.086397:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210560:0@lo:501: 00000100:00100000:0.0:1788448241.086467:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210688:0@lo:503: 00000100:00100000:0.0:1788448241.086519:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.090463:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000009108d247 going to sleep for 11 seconds 00000100:00100000:3.0:1788448241.090706:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210688 00000100:00100000:3.0:1788448241.090720:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210688 00000100:00100000:3.0:1788448241.090784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448241.090793:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007aea335a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6494:x1875323826210688:12345-0@lo:503: 00000040:00080000:3.0:1788448241.090873:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448241.090991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007aea335a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6494:x1875323826210688:12345-0@lo:503: Request processed in 198us (4472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448241.091007:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448241.091300:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210688:0@lo:503: 00000040:00080000:0.0:1788448241.093505:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788448241.093728:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788448241.093750:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448241.093770:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.093784:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448241.093840:0:6494:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448241.093843:0:6494:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc190ac6000 10000000:01000000:3.0:1788448241.093846:0:6494:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc190ac6000 10000000:01000000:3.0:1788448241.093850:0:6494:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448241.093856:0:6494:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc190ac6000 from 1 10000000:01000000:3.0:1788448241.093858:0:6494:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448241.095428:0:6494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.095584:0:6494:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.095601:0:6494:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448241.095633:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e45dacc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210816:0@lo:101: 00000100:00100000:3.0:1788448241.095869:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448241.095953:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d6568f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788448241.096668:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210816 00000100:00100000:2.0:1788448241.096680:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210816 00000100:00100000:2.0:1788448241.096744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448241.096754:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006db3aa42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6494:x1875323826210816:12345-0@lo:101: 00010000:00010000:2.0:1788448241.096773:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448241.096797:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8032af expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.096825:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.096836:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.096845:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d87a6ad, rc 0) 00000100:00100000:2.0:1788448241.096997:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006db3aa42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826210816:12345-0@lo:101: Request processed in 244us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448241.097005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448241.097434:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e45dacc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210816:0@lo:101: 00010000:00010000:3.0:1788448241.097458:0:6494:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.097476:0:6494:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448241.097567:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e45dacc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210944:0@lo:501: 00000100:00100000:3.0:1788448241.097607:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448241.097647:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000005d6568f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788448241.097714:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826210944 00000100:00100000:2.0:1788448241.097720:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826210944 00000100:00100000:2.0:1788448241.097760:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448241.097767:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7eff899 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826210944:12345-0@lo:501: 00000100:00100000:2.0:1788448241.098073:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7eff899 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826210944:12345-0@lo:501: Request processed in 306us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448241.098088:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448241.098457:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e45dacc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826210944:0@lo:501: 00000100:00100000:0.0:1788448241.098495:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826211072:0@lo:503: 00000100:00100000:0.0:1788448241.098538:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.098599:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 000000009108d247 going to sleep for 11 seconds 00000100:00100000:1.0:1788448241.098634:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211072 00000100:00100000:1.0:1788448241.098639:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211072 00000100:00100000:1.0:1788448241.098709:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448241.098716:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b263e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826211072:12345-0@lo:503: 00000100:00100000:1.0:1788448241.098819:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b263e4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826211072:12345-0@lo:503: Request processed in 104us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448241.098826:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448241.098919:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826211072:0@lo:503: 00000100:00100000:0.0:1788448241.099597:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6544:1875323826211200:0@lo:502: 00000100:00100000:0.0:1788448241.099650:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.100041:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 00000000dcd571ce going to sleep for 11 seconds 00000100:00100000:2.0:1788448241.100110:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211200 00000100:00100000:2.0:1788448241.100117:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211200 00000100:00100000:2.0:1788448241.100153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448241.100160:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac2b7883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6544:x1875323826211200:12345-0@lo:502: 00000100:00100000:2.0:1788448241.100285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac2b7883 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6544:x1875323826211200:12345-0@lo:502: Request processed in 124us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448241.100293:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448241.100462:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6544:1875323826211200:0@lo:502: 00000020:01000004:0.0:1788448241.100541:0:6544:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788448241.100561:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b6a15a1e) 00000020:00000080:0.0:1788448241.100584:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788448241.100670:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000faca2b9c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448241.100674:0:6544:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000faca2b9c from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448241.100676:0:6544:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000faca2b9c 4 00010000:00080000:0.0:1788448241.100722:0:6544:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000012af2940@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448241.102348:0:6544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788448241.102616:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788448241.102659:0:6544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448241.102673:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf45a9e4e6b8032c4 00000100:00080000:0.0:1788448241.102686:0:6544:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448241.102691:0:6544:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000012af2940 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448241.102728:0:6544:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000cb56357 x1875323826211328/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448241.102763:0:6544:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788448241.108916:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826211328:0@lo:38: 00000100:00100000:3.0:1788448241.109029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.110624:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211328 00000100:00100000:0.0:1788448241.110643:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211328 00000100:00100000:0.0:1788448241.110699:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448241.110708:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000baaaa984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826211328:12345-0@lo:38: 00000100:00100000:0.0:1788448241.110813:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000baaaa984 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826211328:12345-0@lo:38: Request processed in 105us (1784us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788448241.110821:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448241.110971:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000672a327b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6544:1875323826211456:0@lo:502: 00000100:00100000:0.0:1788448241.111031:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448241.111065:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 000000008ad91153 going to sleep for 11 seconds 00000100:00100000:3.0:1788448241.112615:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788448241.112629:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000012af2940 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448241.112637:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788448241.112642:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000cb56357 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826211328:0@lo:38: 00000100:00100000:3.0:1788448241.113505:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211456 00000100:00100000:3.0:1788448241.113518:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211456 00000100:00100000:3.0:1788448241.113590:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448241.113601:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d78e82b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6544:x1875323826211456:12345-0@lo:502: 00000100:00100000:3.0:1788448241.113804:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d78e82b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6544:x1875323826211456:12345-0@lo:502: Request processed in 205us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448241.113812:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448241.113875:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000672a327b pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6544:1875323826211456:0@lo:502: 00000040:00080000:3.0:1788448241.113936:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788448241.114012:0:6494:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788448241.114035:0:6494:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448241.114057:0:6494:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.114080:0:6494:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788448241.114130:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788448241.114133:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788448241.114135:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448241.114136:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448241.114138:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448241.114139:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448241.114141:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448241.114142:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788448241.114144:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448241.114145:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448241.114147:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448241.114149:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448241.114152:0:6494:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788448241.114155:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448241.114156:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788448241.114157:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448241.114158:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448241.114159:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448241.114160:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448241.114161:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448241.114161:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788448241.114162:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448241.114163:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448241.114164:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448241.114165:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448241.114187:0:6494:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788448241.114202:0:6494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547fecad pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826211584:0@lo:253: 00000100:00100000:3.0:1788448241.114244:0:6494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448241.114274:0:6494:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a815cc26 going to sleep for 11 seconds 00000100:00100000:1.0:1788448241.117156:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211584 00000100:00100000:1.0:1788448241.117173:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211584 00000100:00100000:1.0:1788448241.117239:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448241.117248:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e32b466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826211584:12345-0@lo:253: 20000000:01000000:1.0:1788448241.117298:0:6509:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788448241.117312:0:6509:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788448241.127250:0:6509:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788448241.127500:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788448241.128668:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 00000100:00100000:1.0:1788448241.128668:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e32b466 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6494:x1875323826211584:12345-0@lo:253: Request processed in 11412us (14416us total) trans 0 rc 0/0 10000000:01000000:3.0:1788448241.128675:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:1.0:1788448241.128686:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788448241.128699:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.128730:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.128738:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.128784:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.128828:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 11 pid: 6509 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448241.128843:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826211712:0@lo:104: 00000100:00100000:0.0:1788448241.128845:0:6494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547fecad pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6494:1875323826211584:0@lo:253: 10000000:01000000:0.0:1788448241.128869:0:6494:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788448241.128873:0:6494:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448241.128875:0:6494:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448241.128876:0:6494:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448241.128877:0:6494:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000100:00100000:3.0:1788448241.128924:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448241.128963:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211712 00000100:00100000:2.0:1788448241.128972:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211712 00000100:00100000:3.0:1788448241.128974:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ed6e5a8 going to sleep for 11 seconds 00000100:00100000:2.0:1788448241.129018:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448241.129027:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076ef4599 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826211712:12345-0@lo:104: 00010000:00010000:2.0:1788448241.129040:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.129100:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448241.129105:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076ef4599 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826211712:12345-0@lo:104: Request processed in 80us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448241.129111:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788448241.129130:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448241.129135:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.129142:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf720b89 already unused, calling callback (000000005d7e8dd7) 10000000:00010000:2.0:1788448241.129145:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.129152:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448241.129169:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448241.129173:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448241.129218:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.129225:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448241.129243:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.129249:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 00000000bf720b89/0xf45a9e4e6b803293 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80329a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448241.129282:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448241.129284:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448241.129285:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448241.129362:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448241.129371:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000652a6c03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826211840:0@lo:103: 00000100:00100000:2.0:1788448241.129425:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448241.129743:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211840 00000100:00100000:1.0:1788448241.129749:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211840 00010000:00010000:1.0:1788448241.129767:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 12 pid: 6509 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448241.129798:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448241.129812:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e49991d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3645:x1875323826211840:12345-0@lo:103: 00010000:00010000:1.0:1788448241.129824:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448241.129828:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 12 pid: 6509 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129838:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 12 pid: 6509 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129856:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129863:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448241.129877:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001203284s 00010000:00010000:1.0:1788448241.129908:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129915:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129921:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129926:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129932:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000758b5c87 already unused, calling callback (00000000eede70fe) 00010000:00010000:1.0:1788448241.129935:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129942:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129957:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448241.129968:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448241.130002:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e49991d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3645:x1875323826211840:12345-0@lo:103: Request processed in 190us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448241.130008:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448241.130037:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000652a6c03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826211840:0@lo:103: 00000020:01000004:0.0:1788448241.130201:0:6494:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448241.130205:0:6494:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448241.130207:0:6494:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448241.130208:0:6494:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448241.130209:0:6494:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788448241.130211:0:6494:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788448241.130212:0:6494:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448241.130213:0:6494:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448241.130228:0:6494:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788448241.130351:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e19b33a/0xf45a9e4e6b80329a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803293 expref: 11 pid: 6509 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448241.130365:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826211712:0@lo:104: 00010000:00010000:3.0:1788448241.130379:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.130401:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.130406:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448241.130411:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000758b5c87/0xf45a9e4e6b8032cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788448241.146699:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1788448241.146910:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788448241.147131:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1788448241.147294:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788448241.147522:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1788448241.147690:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:3.0:1788448241.154228:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788448241.155281:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788448241.156865:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788448241.157114:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788448241.157319:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788448241.161378:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788448241.169923:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788448241.187633:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788448241.187769:0:6549:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1788448241.187774:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788448241.188928:0:6550:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788448241.193195:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788448241.193310:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448241.193444:0:6550:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788448241.194226:0:6494:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788448241.194238:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788448241.196528:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448241.197673:0:6494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788448241.198256:0:6494:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788448241.198294:0:6494:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788448241.198504:0:6494:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788448241.198763:0:6494:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:1.0:1788448241.206707:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788448241.206947:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788448241.207097:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000040:00080000:0.0:1788448241.208598:0:6550:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788448241.208678:0:6550:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788448241.208682:0:6550:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:1.0:1788448241.210351:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788448241.210596:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788448241.210745:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788448241.210979:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788448241.211133:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788448241.212437:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788448241.212625:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788448241.212756:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788448241.212878:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788448241.213335:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788448241.213487:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788448241.213647:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788448241.213786:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788448241.214600:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788448241.214767:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788448241.215031:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788448241.215365:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788448241.215612:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788448241.215749:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788448241.215876:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788448241.216091:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788448241.216460:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788448241.216610:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788448241.217355:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788448241.217516:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788448241.217656:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788448241.218158:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788448241.218299:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788448241.218670:0:6494:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788448241.218911:0:6494:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1788448241.229455:0:6494:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788448241.229501:0:6494:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf8c01c6f988 00100000:10000000:0.0:1788448241.229509:0:6494:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788448241.230135:0:6494:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788448241.230150:0:6494:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788448241.230172:0:6494:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788448241.230186:0:6494:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788448241.231015:0:6494:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448241.231168:0:6494:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788448241.667295:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448242.687112:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448243.710923:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448244.737827:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448245.764930:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448245.834631:0:6795:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788448246.462274:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788448246.462282:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448246.462285:0:37:0:(import.c:65:import_set_state_nolock()) 0000000012af2940 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448246.462307:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000012af2940 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448246.462329:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007d6ae45c x1875323826212096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448246.462372:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d6ae45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826212096:0@lo:38: 00000100:00100000:3.0:1788448246.462433:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448246.462659:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448246.462668:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826211968:0@lo:400: 00000100:00100000:0.0:1788448246.462703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448246.463478:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212096 00000100:00100000:2.0:1788448246.463489:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212096 00000100:00100000:2.0:1788448246.463523:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448246.463530:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008147eed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826212096:12345-0@lo:38: 00010000:00080000:2.0:1788448246.463554:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:2.0:1788448246.463595:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf45a9e4e6b8032d2 00000004:00100000:2.0:1788448246.463636:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448246.463759:0:6519:0:(import.c:65:import_set_state_nolock()) 000000006286d7f7 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448246.463821:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008147eed7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875323826212096:12345-0@lo:38: Request processed in 290us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448246.463829:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788448246.463875:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007d6ae45c x1875323826212096/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788448246.463906:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788448246.463913:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788448246.463917:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448246.463919:0:3644:0:(import.c:65:import_set_state_nolock()) 0000000012af2940 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448246.463925:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d6ae45c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826212096:0@lo:38: 00000100:00100000:3.0:1788448246.464011:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826211968 00000100:00100000:3.0:1788448246.464015:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826211968 00000100:00100000:3.0:1788448246.464058:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788448246.464065:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f00b2def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:3648:x1875323826211968:12345-0@lo:400: 00000100:00100000:3.0:1788448246.464105:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f00b2def pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:3648:x1875323826211968:12345-0@lo:400: Request processed in 41us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448246.464111:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788448246.464147:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826211968:0@lo:400: 00000020:00000004:1.0:1788448246.765761:0:6847:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448246.766426:0:6847:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448246.782674:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448247.806099:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448248.510013:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448248.510021:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc190ac6000 from 3 10000000:01000000:2.0:1788448248.510026:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448248.510212:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448248.510245:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448248.510257:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448248.510280:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016bbb92d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826212224:0@lo:101: 00000100:00100000:2.0:1788448248.510380:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448248.510455:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212224 00000100:00100000:1.0:1788448248.510465:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212224 00000100:00100000:2.0:1788448248.510468:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000001244be2a going to sleep for 11 seconds 00000100:00100000:1.0:1788448248.510528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448248.510536:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097e1aaf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:6514:x1875323826212224:12345-0@lo:101: 00010000:00010000:1.0:1788448248.510550:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448248.510562:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8032d9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448248.510584:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448248.510593:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448248.510601:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000576fb72b, rc 0) 00000100:00100000:1.0:1788448248.510649:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097e1aaf6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6514:x1875323826212224:12345-0@lo:101: Request processed in 114us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448248.510656:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448248.510816:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016bbb92d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826212224:0@lo:101: 00010000:00010000:2.0:1788448248.510829:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448248.510837:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448248.510899:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016bbb92d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826212352:0@lo:256: 00000100:00100000:2.0:1788448248.510928:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448248.510955:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000001244be2a going to sleep for 11 seconds 00000100:00100000:0.0:1788448248.511003:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212352 00000100:00100000:0.0:1788448248.511007:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212352 00000100:00100000:0.0:1788448248.511038:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448248.511044:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e5e2cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6514:x1875323826212352:12345-0@lo:256: 20000000:01000000:0.0:1788448248.511057:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448248.511082:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448248.511085:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788448248.511174:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e5e2cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:6514:x1875323826212352:12345-0@lo:256: Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448248.511181:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448248.511438:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016bbb92d pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826212352:0@lo:256: 10000000:01000000:2.0:1788448248.511477:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448248.511483:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448248.511490:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448248.834922:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448249.749245:0:6948:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448249.749531:0:6948:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448249.858241:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448250.879858:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448251.582533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448251.582556:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826212480:0@lo:400: 00000100:00100000:3.0:1788448251.582622:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448251.582680:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ee2bf4f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826212608:0@lo:400: 00000100:00100000:3.0:1788448251.582995:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448251.583079:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212480 00000100:00100000:3.0:1788448251.583086:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212480 00000100:00100000:3.0:1788448251.583125:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448251.583133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f59bd9b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3647:x1875323826212480:12345-0@lo:400: 00000100:00100000:3.0:1788448251.583179:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f59bd9b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3647:x1875323826212480:12345-0@lo:400: Request processed in 47us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448251.583186:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448251.583227:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826212480:0@lo:400: 00000100:00100000:0.0:1788448251.588478:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212608 00000100:00100000:0.0:1788448251.588493:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212608 00000100:00100000:0.0:1788448251.588562:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448251.588571:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c765d59c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826212608:12345-0@lo:400: 00000100:00100000:0.0:1788448251.588667:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c765d59c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826212608:12345-0@lo:400: Request processed in 98us (5672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448251.588674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788448251.588923:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ee2bf4f3 x1875323826212608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448251.588938:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ee2bf4f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826212608:0@lo:400: 00010000:00010000:2.0:1788448251.902157:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448252.926117:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448253.950234:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448254.982199:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448255.999270:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448256.706553:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016bbb92d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826212736:0@lo:400: 00000100:00100000:3.0:1788448256.706651:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448256.706742:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003895ddf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826212864:0@lo:400: 00000100:00100000:3.0:1788448256.706775:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448256.706815:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212736 00000100:00100000:3.0:1788448256.706824:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212736 00000100:00100000:3.0:1788448256.706896:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448256.706905:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b10fba4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3646:x1875323826212736:12345-0@lo:400: 00000100:00100000:3.0:1788448256.706954:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b10fba4f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3646:x1875323826212736:12345-0@lo:400: Request processed in 50us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448256.706961:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448256.706996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212864 00000100:00100000:3.0:1788448256.707000:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212864 00000100:00100000:3.0:1788448256.707038:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448256.707044:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee2bf4f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826212864:12345-0@lo:400: 00000100:00100000:3.0:1788448256.707079:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee2bf4f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826212864:12345-0@lo:400: Request processed in 36us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448256.707085:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448256.707123:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016bbb92d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826212736:0@lo:400: 00010000:00080000:3.0:1788448256.707153:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003895ddf0 x1875323826212864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448256.707166:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003895ddf0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826212864:0@lo:400: 00010000:00010000:3.0:1788448257.025483:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448258.048267:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448259.075247:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448260.094176:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448260.235586:0:7447:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448260.235590:0:7447:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788448260.235592:0:7447:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788448260.235742:0:7447:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009b004709 00000020:01000004:3.0:1788448260.235758:0:7447:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:3.0:1788448260.235769:0:7447:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788448260.235783:0:7447:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000004c7df8ba) 00000020:00000080:3.0:1788448260.235797:0:7447:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448260.297417:0:7447:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788448260.297512:0:7447:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:2.0:1788448260.323797:0:7447:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788448260.325119:0:7447:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788448260.325131:0:7447:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788448260.325142:0:7447:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b8032ee 00000020:01000004:2.0:1788448260.325149:0:7447:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788448260.325246:0:7447:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788448260.325250:0:7447:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788448260.325256:0:7447:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788448260.325311:0:7447:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788448260.325316:0:7447:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788448260.347264:0:7447:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788448260.347318:0:7447:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788448260.347322:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788448260.347324:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788448260.347326:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448260.347327:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448260.347328:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448260.347330:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448260.347403:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448260.347404:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788448260.347406:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788448260.347407:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448260.347409:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448260.347413:0:7447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788448260.347416:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448260.347417:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788448260.347418:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448260.347419:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448260.347420:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448260.347422:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448260.347423:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448260.347424:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788448260.347425:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788448260.347426:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448260.347427:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448260.347458:0:7447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788448260.347479:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfad9ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826212992:0@lo:253: 00000100:00100000:0.0:1788448260.347561:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.347660:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000005ed4268d going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.347711:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826212992 00000100:00100000:3.0:1788448260.347720:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826212992 00000100:00100000:3.0:1788448260.347804:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448260.347814:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ff181ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826212992:12345-0@lo:253: 20000000:01000000:3.0:1788448260.347848:0:6511:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788448260.347854:0:6511:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788448260.347859:0:6511:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788448260.347863:0:6511:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788448260.347933:0:6511:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788448260.348139:0:6511:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448260.348289:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788448260.348305:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788448260.348323:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788448260.348349:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788448260.348365:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788448260.348421:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788448260.348429:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788448260.348443:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788448260.348448:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788448260.348473:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788448260.348479:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788448260.348490:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788448260.348504:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788448260.348624:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788448260.348635:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:3.0:1788448260.348648:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788448260.348653:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788448260.348666:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788448260.348672:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:3.0:1788448260.348685:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788448260.348690:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788448260.348702:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788448260.348717:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788448260.348727:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788448260.348800:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788448260.348809:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788448260.348822:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788448260.348837:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788448260.348852:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788448260.348858:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788448260.348870:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788448260.348931:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788448260.348937:0:6511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788448260.348957:0:6511:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788448260.348964:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788448260.349622:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788448260.349812:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788448260.349835:0:6511:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.121@tcp for mdt 20000000:01000000:0.0:1788448260.349837:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448260.349852:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788448260.349857:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788448260.349869:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788448260.349875:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448260.349944:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788448260.349964:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788448260.349981:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788448260.349996:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788448260.350045:0:6511:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788448260.350054:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1788448260.351074:0:7454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788448260.351314:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788448260.351346:0:6511:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.121@tcp for mdt 20000000:01000000:0.0:1788448260.351349:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448260.351364:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788448260.351369:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448260.351382:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788448260.351387:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448260.351399:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788448260.351405:0:6511:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788448260.351416:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788448260.351431:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788448260.351451:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788448260.351454:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788448260.351458:0:6511:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788448260.351502:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788448260.351504:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448260.352102:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448260.352128:0:7455:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448260.352143:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788448260.352432:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788448260.352450:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788448260.352470:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788448260.352479:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788448260.352481:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448260.352699:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448260.352716:0:7456:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448260.352728:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788448260.352861:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788448260.353045:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788448260.353070:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788448260.353080:0:6511:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788448260.353082:0:6511:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448260.353455:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448260.353474:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448260.353487:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788448260.353633:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788448260.353661:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788448260.353676:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788448260.353690:0:6511:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788448260.353692:0:6511:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788448260.353697:0:6511:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788448260.353702:0:6511:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788448260.354144:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788448260.354397:0:6511:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788448260.365673:0:6511:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788448260.365716:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.365753:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.365761:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.365768:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.365773:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.365814:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.365827:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 12 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448260.365841:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099dafb50 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875323826213120:0@lo:104: 00000100:00100000:0.0:1788448260.366032:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448260.366087:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.366095:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 12 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448260.366103:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009af6e56f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875323826213248:0@lo:104: 00000100:00100000:0.0:1788448260.366121:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.366149:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213120 00000100:00100000:0.0:1788448260.366165:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213120 00000100:00100000:0.0:1788448260.366203:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213248 00000100:00100000:0.0:1788448260.366205:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213248 00000100:00100000:0.0:1788448260.366216:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448260.366223:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000153e019c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6511:x1875323826213120:12345-0@lo:104: 00010000:00010000:0.0:1788448260.366234:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.366275:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448260.366290:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000153e019c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6511:x1875323826213120:12345-0@lo:104: Request processed in 57us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.366298:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448260.366315:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448260.366321:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6d7e874 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6511:x1875323826213248:12345-0@lo:104: 00010000:00010000:0.0:1788448260.366327:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.366363:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448260.366367:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6d7e874 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6511:x1875323826213248:12345-0@lo:104: Request processed in 47us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.366379:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788448260.366403:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.366411:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 12 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448260.366419:0:6511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051f3dc69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875323826213376:0@lo:104: 00000100:00100000:0.0:1788448260.366438:0:6511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.366452:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213376 00000100:00100000:0.0:1788448260.366455:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213376 00000100:00100000:0.0:1788448260.366467:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448260.366472:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a91dd68b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6511:x1875323826213376:12345-0@lo:104: 00010000:00010000:0.0:1788448260.366478:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.366497:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788448260.366501:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a91dd68b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6511:x1875323826213376:12345-0@lo:104: Request processed in 30us (63us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.366506:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448260.366518:0:6511:0:(client.c:2715:ptlrpc_set_wait()) set 0000000097618401 going to sleep for 11 seconds 00000100:00100000:0.0:1788448260.366534:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099dafb50 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875323826213120:0@lo:104: 00000100:00100000:0.0:1788448260.366541:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009af6e56f pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875323826213248:0@lo:104: 00000100:00100000:0.0:1788448260.366546:0:6511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051f3dc69 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6511:1875323826213376:0@lo:104: 00010000:00010000:0.0:1788448260.366564:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366740:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448260.366746:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366754:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a9d668a already unused, calling callback (000000005d7e8dd7) 10000000:00010000:3.0:1788448260.366757:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366764:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448260.366771:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448260.366776:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448260.366812:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366819:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448260.366835:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366841:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b8032af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032b6 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366854:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448260.366856:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366860:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dff4bf4a already unused, calling callback (000000005d7e8dd7) 10000000:00010000:3.0:1788448260.366862:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366868:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448260.366872:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448260.366877:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448260.366906:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366911:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448260.366921:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366935:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b80323f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803246 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366944:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448260.366946:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366951:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005a158c3f already unused, calling callback (000000005d7e8dd7) 10000000:00010000:3.0:1788448260.366953:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366958:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448260.366963:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448260.366968:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448260.366977:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366982:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448260.366985:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.366990:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 000000005a158c3f/0xf45a9e4e6b803223 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80322a expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367000:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448260.367005:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448260.367006:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448260.367017:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826213504:0@lo:103: 00000100:00100000:3.0:1788448260.367044:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.367082:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003f8d5266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826213632:0@lo:103: 00000100:00100000:3.0:1788448260.367099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.367113:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448260.367117:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826213760:0@lo:103: 00000100:00100000:3.0:1788448260.367131:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.367167:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213504 00000100:00100000:3.0:1788448260.367171:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213504 00010000:00010000:3.0:1788448260.367188:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 13 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.367201:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213632 00000100:00100000:3.0:1788448260.367203:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213632 00010000:00010000:3.0:1788448260.367210:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 14 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.367218:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213760 00000100:00100000:3.0:1788448260.367220:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213760 00010000:00010000:3.0:1788448260.367226:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 15 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.367235:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448260.367240:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fd361b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3648:x1875323826213504:12345-0@lo:103: 00010000:00010000:3.0:1788448260.367248:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448260.367251:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 15 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367268:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 15 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367290:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8032b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8032af expref: 15 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367303:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448260.367327:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fd361b8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:3648:x1875323826213504:12345-0@lo:103: Request processed in 88us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.367425:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448260.367439:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448260.367445:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad3b7792 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:3645:x1875323826213632:12345-0@lo:103: 00010000:00010000:3.0:1788448260.367453:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448260.367456:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 13 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367464:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 13 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367473:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000850820e9/0xf45a9e4e6b803246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80323f expref: 13 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367480:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448260.367505:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad3b7792 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:3645:x1875323826213632:12345-0@lo:103: Request processed in 61us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.367510:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448260.367522:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448260.367527:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a01c250f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:3645:x1875323826213760:12345-0@lo:103: 00010000:00010000:3.0:1788448260.367555:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448260.367559:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 11 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367566:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 11 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367574:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b80322a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803223 expref: 11 pid: 6510 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367585:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367591:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367603:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367609:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367615:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367620:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367626:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a231938d already unused, calling callback (00000000eede70fe) 00010000:00010000:3.0:1788448260.367629:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367644:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367654:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.367664:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448260.367684:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a01c250f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:3645:x1875323826213760:12345-0@lo:103: Request processed in 158us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.367690:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448260.367726:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826213760:0@lo:103: 00000100:00100000:3.0:1788448260.367733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003f8d5266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826213632:0@lo:103: 00000100:00100000:3.0:1788448260.367751:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826213504:0@lo:103: 00010000:00010000:0.0:1788448260.368073:0:6511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.368081:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.368086:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8032f5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788448260.368100:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:0.0:1788448260.369002:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448260.370587:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ff181ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:7447:x1875323826212992:12345-0@lo:253: Request processed in 22770us (23021us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.370601:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448260.370679:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfad9ecf pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826212992:0@lo:253: 10000000:01000000:1.0:1788448260.370693:0:7447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788448260.370695:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448260.370697:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788448260.370698:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448260.370699:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1788448260.370700:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448260.370701:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448260.370702:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448260.370714:0:7447:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788448260.370715:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448260.370716:0:7447:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788448260.370733:0:7447:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b004709 from lustre-MDT0001 10000000:01000000:1.0:1788448260.370765:0:7447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788448260.370768:0:7447:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788448260.370775:0:7447:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc19ebe99b8 local copy 10000000:01000000:1.0:1788448260.370779:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788448260.370866:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.370877:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.371064:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.371082:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826213888:0@lo:101: 00000100:00100000:1.0:1788448260.371121:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.371238:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826213888 00000100:00100000:3.0:1788448260.371245:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826213888 00000100:00100000:3.0:1788448260.371301:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448260.371309:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a8158b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:7447:x1875323826213888:12345-0@lo:101: 00010000:00010000:3.0:1788448260.371320:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448260.371344:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000daca2270/0xf45a9e4e6b803303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8032fc expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.371365:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000daca2270/0xf45a9e4e6b803303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032fc expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.371375:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000daca2270/0xf45a9e4e6b803303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032fc expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.371396:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000daca2270, rc 0) 00000100:00100000:3.0:1788448260.371423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a8158b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:7447:x1875323826213888:12345-0@lo:101: Request processed in 116us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.371429:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448260.371529:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ac03d7f going to sleep for 11 seconds 00000100:00100000:1.0:1788448260.371545:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826213888:0@lo:101: 00010000:00010000:1.0:1788448260.371558:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.371566:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.371655:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214016:0@lo:501: 00000100:00100000:1.0:1788448260.371679:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.371700:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ac03d7f going to sleep for 11 seconds 00000100:00100000:0.0:1788448260.371754:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214016 00000100:00100000:0.0:1788448260.371758:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214016 00000100:00100000:0.0:1788448260.371799:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448260.371806:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b739a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:7447:x1875323826214016:12345-0@lo:501: 00000100:00100000:0.0:1788448260.371859:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b739a7e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:7447:x1875323826214016:12345-0@lo:501: Request processed in 54us (180us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448260.371866:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448260.372032:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214016:0@lo:501: 10000000:01000000:1.0:1788448260.372051:0:7447:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788448260.372068:0:7447:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788448260.372072:0:7447:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.372080:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.372086:0:7447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.372128:0:7447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448260.372149:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc19ea22000 10000000:01000000:1.0:1788448260.372153:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788448260.372236:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448260.372241:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.372248:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e19b33a already unused, calling callback (000000005d7e8dd7) 10000000:00010000:3.0:1788448260.372251:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.372258:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448260.372263:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448260.372268:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448260.372297:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.372303:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448260.372329:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.372344:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8032fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b803303 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.372370:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448260.372372:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448260.372373:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448260.372380:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448260.372390:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826214144:0@lo:103: 00000100:00100000:3.0:1788448260.372421:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.372457:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214144 00000100:00100000:3.0:1788448260.372460:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214144 00000100:00100000:3.0:1788448260.372491:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448260.372497:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f8d5266 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:3648:x1875323826214144:12345-0@lo:103: 00010000:00010000:3.0:1788448260.372506:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448260.372517:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000daca2270/0xf45a9e4e6b803303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8032fc expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.372528:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448260.372563:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f8d5266 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:3648:x1875323826214144:12345-0@lo:103: Request processed in 66us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.372570:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448260.372595:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a70a5e02 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826214144:0@lo:103: 10000000:01000000:1.0:1788448260.372683:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fc19ebe99b8 10000000:01000000:1.0:1788448260.372688:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788448260.372691:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fc19ebe99b8 from 1 10000000:01000000:1.0:1788448260.372694:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788448260.372710:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.372717:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.372729:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.372741:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214272:0@lo:101: 00000100:00100000:1.0:1788448260.372766:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.372803:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.373064:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214272 00000100:00100000:3.0:1788448260.373068:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214272 00000100:00100000:3.0:1788448260.373099:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448260.373105:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074efbd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:7447:x1875323826214272:12345-0@lo:101: 00010000:00010000:3.0:1788448260.373114:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448260.373123:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000933940aa/0xf45a9e4e6b803311 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80330a expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.373151:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000933940aa/0xf45a9e4e6b803311 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80330a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.373262:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000933940aa/0xf45a9e4e6b803311 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80330a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.373271:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000933940aa, rc 0) 00000100:00100000:3.0:1788448260.373312:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074efbd3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:7447:x1875323826214272:12345-0@lo:101: Request processed in 208us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.373318:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448260.373452:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214272:0@lo:101: 00010000:00010000:1.0:1788448260.373464:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.373472:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448260.373487:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788448260.373501:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.373508:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000001f3377ef/0xf45a9e4e6b80330a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448260.373515:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc19ea22000 10000000:01000000:1.0:1788448260.373519:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788448260.373521:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc19ea22000 from 1 10000000:01000000:1.0:1788448260.373523:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788448260.373536:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.373541:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.373547:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.373557:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214400:0@lo:101: 00000100:00100000:1.0:1788448260.373581:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.373615:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.373688:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214400 00000100:00100000:3.0:1788448260.373693:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214400 00000100:00100000:3.0:1788448260.373723:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448260.373729:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c295a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+10:7447:x1875323826214400:12345-0@lo:101: 00010000:00010000:3.0:1788448260.373737:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448260.373744:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006b229577/0xf45a9e4e6b80331f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803318 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.373756:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b229577/0xf45a9e4e6b80331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803318 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.373763:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006b229577/0xf45a9e4e6b80331f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803318 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.373769:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006b229577, rc 0) 00000100:00100000:3.0:1788448260.373905:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c295a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:7447:x1875323826214400:12345-0@lo:101: Request processed in 151us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.373912:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448260.374011:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214400:0@lo:101: 00010000:00010000:1.0:1788448260.374020:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.374027:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448260.374038:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788448260.374078:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.374085:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000bc4f5dd5/0xf45a9e4e6b803318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448260.374092:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788448260.374095:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448260.374099:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc19ea22000 10000000:01000000:1.0:1788448260.374101:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788448260.374105:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1788448260.374107:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788448260.374121:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.374126:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.374133:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.374144:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214528:0@lo:101: 00000100:00100000:1.0:1788448260.374186:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.374212:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.374322:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214528 00000100:00100000:3.0:1788448260.374327:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214528 00000100:00100000:3.0:1788448260.374368:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448260.374374:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f6e24f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+11:7447:x1875323826214528:12345-0@lo:101: 00010000:00010000:3.0:1788448260.374381:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448260.374389:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000051bd1b03/0xf45a9e4e6b80332d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803326 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.374402:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000051bd1b03/0xf45a9e4e6b80332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.374409:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000051bd1b03/0xf45a9e4e6b80332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.374416:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000051bd1b03, rc 0) 00000100:00100000:3.0:1788448260.374444:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f6e24f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214528:12345-0@lo:101: Request processed in 71us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.374450:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448260.374584:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214528:0@lo:101: 00010000:00010000:1.0:1788448260.374595:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.374602:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.374685:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214656:0@lo:501: 00000100:00100000:1.0:1788448260.374711:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.374732:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.374979:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214656 00000100:00100000:3.0:1788448260.374984:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214656 00000100:00100000:3.0:1788448260.375010:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448260.375017:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002caff302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214656:12345-0@lo:501: 00000100:00100000:3.0:1788448260.375106:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002caff302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214656:12345-0@lo:501: Request processed in 90us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.375113:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448260.375263:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214656:0@lo:501: 00000100:00100000:1.0:1788448260.375318:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214784:0@lo:503: 00000100:00100000:1.0:1788448260.375368:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.375389:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:1.0:1788448260.375402:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214784 00000100:00100000:1.0:1788448260.375406:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214784 00000100:00100000:1.0:1788448260.375429:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788448260.375434:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e49e30e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214784:12345-0@lo:503: 00000100:00100000:1.0:1788448260.375513:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e49e30e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214784:12345-0@lo:503: Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.375520:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788448260.375558:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214784:0@lo:503: 00000040:00080000:1.0:1788448260.375810:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448260.375912:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214912:0@lo:502: 00000100:00100000:1.0:1788448260.375951:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.375966:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:1.0:1788448260.375980:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826214912 00000100:00100000:1.0:1788448260.375983:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826214912 00000100:00100000:1.0:1788448260.376003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448260.376008:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fac08a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214912:12345-0@lo:502: 00000100:00100000:1.0:1788448260.376101:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fac08a5a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826214912:12345-0@lo:502: Request processed in 93us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.376107:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448260.376143:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826214912:0@lo:502: 00000040:00080000:1.0:1788448260.376652:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788448260.376678:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:1.0:1788448260.376690:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:1.0:1788448260.376703:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:1.0:1788448260.376717:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:1.0:1788448260.376730:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:1.0:1788448260.376744:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:1.0:1788448260.376756:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:1.0:1788448260.376769:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:1.0:1788448260.376781:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:1.0:1788448260.376807:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:1.0:1788448260.376823:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:1.0:1788448260.376837:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:1.0:1788448260.376850:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:1.0:1788448260.376863:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:1.0:1788448260.376875:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:1.0:1788448260.376916:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:1.0:1788448260.376930:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:1.0:1788448260.376943:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:1.0:1788448260.376956:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:1.0:1788448260.378482:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:1.0:1788448260.378526:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:1.0:1788448260.378538:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:1.0:1788448260.378575:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215040:0@lo:502: 00000100:00100000:1.0:1788448260.378651:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.378691:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:1.0:1788448260.378719:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215040 00000100:00100000:1.0:1788448260.378725:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215040 00000100:00100000:1.0:1788448260.378759:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448260.378766:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009438287d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826215040:12345-0@lo:502: 00000100:00100000:1.0:1788448260.378869:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009438287d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826215040:12345-0@lo:502: Request processed in 103us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.378876:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448260.378943:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ed36aadb pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215040:0@lo:502: 00000040:00080000:1.0:1788448260.378997:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:1.0:1788448260.379005:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:2.0:1788448260.380545:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448260.380559:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.380562:0:7459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788448260.380566:0:7459:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788448260.380569:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448260.380582:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000066255e85) 00000020:00000080:2.0:1788448260.380599:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:2.0:1788448260.380605:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788448260.380670:0:7459:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448260.380688:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b80333b 00000020:00000080:2.0:1788448260.381293:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788448260.381299:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448260.381303:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.381305:0:7459:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788448260.381315:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448260.381319:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.381321:0:7459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788448260.381324:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448260.381446:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000db24965d) 00000020:00000080:2.0:1788448260.381462:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:2.0:1788448260.381468:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788448260.381470:0:7459:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788448260.381472:0:7459:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788448260.381477:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788448260.381543:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b004709 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788448260.381558:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000802299c7) 00000020:00000080:2.0:1788448260.381569:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:2.0:1788448260.381646:0:7459:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788448260.381652:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b803350 00000020:00000080:2.0:1788448260.381759:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788448260.381765:0:7459:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788448260.381770:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf45a9e4e6b803357 00080000:01000000:2.0:1788448260.381775:0:7459:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788448260.381779:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b80335e 00080000:10000000:2.0:1788448260.383559:0:7459:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:2.0:1788448260.383736:0:7459:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788448260.501423:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788448260.501714:0:7459:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:3.0:1788448260.504865:0:7459:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788448260.505726:0:7459:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788448260.518546:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788448260.518562:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448260.518576:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448260.518578:0:7459:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788448260.518582:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448260.518588:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448260.518589:0:7459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788448260.518593:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448260.518598:0:7459:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:00000080:3.0:1788448260.518624:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448260.518639:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000010b33da8) 00000020:00000080:3.0:1788448260.518659:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788448260.518664:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448260.518733:0:7459:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788448260.518739:0:7459:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788448260.518894:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b80336c 00010000:00080000:3.0:1788448260.518935:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006553d5b4@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448260.524502:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788448260.529152:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788448260.529314:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788448260.529439:0:7459:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788448260.529462:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b803373 00000100:00080000:2.0:1788448260.529473:0:7459:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448260.529478:0:7459:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000006553d5b4 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448260.529511:0:7459:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006f630330 x1875323826215168/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448260.529589:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f630330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826215168:0@lo:38: 00000100:00100000:3.0:1788448260.529661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.529769:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215168 00000100:00100000:0.0:1788448260.529777:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215168 00000100:00100000:0.0:1788448260.529808:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448260.529815:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a70a5e02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826215168:12345-0@lo:38: 00010000:00080000:0.0:1788448260.529836:0:6522:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:0.0:1788448260.529867:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80337a 00000004:00100000:0.0:1788448260.529902:0:6522:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788448260.529909:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788448260.530136:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788448260.530314:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448260.530319:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.530321:0:7459:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788448260.530324:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788448260.530326:0:7459:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788448260.530328:0:7459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448260.530398:0:7459:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448260.530401:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788448260.530403:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.530404:0:7459:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788448260.530407:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448260.530411:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.530412:0:7459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788448260.530416:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788448260.530454:0:7459:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788448260.530466:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448260.530470:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.530471:0:7459:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788448260.530473:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448260.530475:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.530476:0:7459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448260.530479:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448260.530480:0:7459:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788448260.530505:0:7459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448260.530508:0:7459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448260.530509:0:7459:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788448260.530512:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788448260.530517:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008542fe35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826215296:0@lo:400: 00000100:00100000:1.0:1788448260.530560:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788448260.530593:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:1.0:1788448260.530620:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788448260.530632:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.530642:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000daf22adf/0xf45a9e4e6b803326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448260.530651:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc19ea22000 from 1 10000000:01000000:1.0:1788448260.530654:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448260.530684:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.530690:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.530698:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.530710:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e472e603 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215424:0@lo:101: 00000100:00100000:0.0:1788448260.531008:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215296 00000100:00100000:0.0:1788448260.531014:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215296 00000100:00100000:0.0:1788448260.531054:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448260.531061:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed36aadb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826215296:12345-0@lo:400: 00000100:00100000:0.0:1788448260.531112:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed36aadb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826215296:12345-0@lo:400: Request processed in 52us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.531119:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788448260.531316:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008542fe35 x1875323826215296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448260.531339:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008542fe35 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826215296:0@lo:400: 00000100:00100000:1.0:1788448260.532897:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448260.532947:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215424 00000100:00100000:1.0:1788448260.532949:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:2.0:1788448260.533024:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215424 00000100:00100000:2.0:1788448260.533074:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448260.533082:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038992e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+12:7447:x1875323826215424:12345-0@lo:101: 00010000:00010000:2.0:1788448260.533103:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448260.533118:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803381 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.533142:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.533151:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.533161:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000054a6adf8, rc 0) 00000100:00100000:2.0:1788448260.533359:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038992e6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:7447:x1875323826215424:12345-0@lo:101: Request processed in 278us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.533366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788448260.533428:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e472e603 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215424:0@lo:101: 00010000:00010000:1.0:1788448260.533444:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.533453:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.534308:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e472e603 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215552:0@lo:256: 00000100:00100000:1.0:1788448260.534430:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.534465:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000009e01e168 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.534626:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215552 00000100:00100000:3.0:1788448260.534634:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215552 00000100:00100000:3.0:1788448260.534676:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448260.534683:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042a6ba06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:7447:x1875323826215552:12345-0@lo:256: 20000000:01000000:3.0:1788448260.534700:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788448260.535822:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788448260.535830:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788448260.535987:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042a6ba06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:7447:x1875323826215552:12345-0@lo:256: Request processed in 1293us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.535996:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448260.536051:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e472e603 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215552:0@lo:256: 10000000:01000000:3.0:1788448260.536903:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448260.536930:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.536941:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448260.536948:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc19ea22000 from 1 10000000:01000000:3.0:1788448260.536951:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448260.537045:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.537053:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.537061:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.537079:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215680:0@lo:101: 00000100:00100000:3.0:1788448260.537118:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.537149:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c44e396e going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.537302:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215680 00000100:00100000:3.0:1788448260.537309:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215680 00000100:00100000:3.0:1788448260.537423:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448260.537432:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b158e5bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:7447:x1875323826215680:12345-0@lo:101: 00010000:00010000:3.0:1788448260.537443:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448260.537456:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80338f expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.537477:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.537500:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.537509:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a0de57c0, rc 0) 00000100:00100000:3.0:1788448260.537543:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b158e5bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:7447:x1875323826215680:12345-0@lo:101: Request processed in 113us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.537549:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448260.537586:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215680:0@lo:101: 00010000:00010000:3.0:1788448260.537599:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.537607:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.537710:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215808:0@lo:501: 00000100:00100000:3.0:1788448260.537735:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448260.537926:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215808 00000100:00100000:2.0:1788448260.537931:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215808 00000100:00100000:2.0:1788448260.537957:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448260.537963:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d7fae40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:7447:x1875323826215808:12345-0@lo:501: 00000100:00100000:2.0:1788448260.538428:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d7fae40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:7447:x1875323826215808:12345-0@lo:501: Request processed in 464us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.538436:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448260.538490:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c44e396e going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.538503:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215808:0@lo:501: 00000100:00100000:3.0:1788448260.538530:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215936:0@lo:503: 00000100:00100000:3.0:1788448260.538572:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.538628:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c44e396e going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.540469:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826215936 00000100:00100000:3.0:1788448260.540485:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826215936 00000100:00100000:3.0:1788448260.540540:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448260.540549:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007167d87c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:7447:x1875323826215936:12345-0@lo:503: 00000040:00080000:3.0:1788448260.540600:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448260.540692:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007167d87c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:7447:x1875323826215936:12345-0@lo:503: Request processed in 144us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.540698:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448260.541494:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826215936:0@lo:503: 00000040:00080000:1.0:1788448260.541853:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448260.541932:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788448260.542087:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:1.0:1788448260.542536:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000a45dfee3 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448260.542629:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a70a5e02 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826215168:12345-0@lo:38: Request processed in 12812us (12968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.542653:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448260.542948:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448260.542957:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788448260.542965:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788448260.542970:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788448260.542972:0:3644:0:(import.c:65:import_set_state_nolock()) 000000006553d5b4 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788448260.543056:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f630330 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826215168:0@lo:38: 00000100:00100000:3.0:1788448260.543150:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448260.543230:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f90eab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826216064:0@lo:41: 00000100:00100000:3.0:1788448260.543273:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.543395:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216064 00000100:00100000:3.0:1788448260.543401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216064 00000100:00100000:3.0:1788448260.543438:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448260.543445:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044754b82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826216064:12345-0@lo:41: 00000004:00000024:3.0:1788448260.543468:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788448260.543504:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044754b82 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826216064:12345-0@lo:41: Request processed in 59us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.543509:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448260.543537:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f90eab3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826216064:0@lo:41: 00000040:00080000:0.0:1788448260.544856:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788448260.545130:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788448260.545247:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448260.545267:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.545286:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448260.545437:0:7447:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448260.545440:0:7447:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc19ea22000 10000000:01000000:3.0:1788448260.545444:0:7447:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc19ea22000 10000000:01000000:3.0:1788448260.545448:0:7447:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448260.545454:0:7447:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc19ea22000 from 1 10000000:01000000:3.0:1788448260.545456:0:7447:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448260.545500:0:7447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.545509:0:7447:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.545518:0:7447:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.545535:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f90eab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216192:0@lo:101: 00000100:00100000:3.0:1788448260.545590:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.545629:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000001570f4ef going to sleep for 11 seconds 00000100:00100000:2.0:1788448260.545733:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216192 00000100:00100000:2.0:1788448260.545741:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216192 00000100:00100000:2.0:1788448260.545846:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448260.545854:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d6bd36b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:7447:x1875323826216192:12345-0@lo:101: 00010000:00010000:2.0:1788448260.545866:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448260.545878:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8033a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80339d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.545940:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8033a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.545949:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004d87a6ad/0xf45a9e4e6b8033a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.545956:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004d87a6ad, rc 0) 00000100:00100000:2.0:1788448260.546420:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d6bd36b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216192:12345-0@lo:101: Request processed in 566us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.546427:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448260.546587:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f90eab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216192:0@lo:101: 00010000:00010000:3.0:1788448260.546601:0:7447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.546608:0:7447:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.546679:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009f90eab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216320:0@lo:501: 00000100:00100000:3.0:1788448260.546701:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.546725:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 000000001570f4ef going to sleep for 11 seconds 00000100:00100000:2.0:1788448260.546735:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216320 00000100:00100000:2.0:1788448260.546739:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216320 00000100:00100000:2.0:1788448260.546836:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448260.546843:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cba1f4bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216320:12345-0@lo:501: 00000100:00100000:2.0:1788448260.547090:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cba1f4bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216320:12345-0@lo:501: Request processed in 247us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.547098:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788448260.547295:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009f90eab3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216320:0@lo:501: 00000100:00100000:1.0:1788448260.547326:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216448:0@lo:503: 00000100:00100000:1.0:1788448260.547434:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.547491:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000158b014e going to sleep for 11 seconds 00000100:00100000:0.0:1788448260.547527:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216448 00000100:00100000:0.0:1788448260.547532:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216448 00000100:00100000:0.0:1788448260.547597:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448260.547605:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002faf9726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216448:12345-0@lo:503: 00000100:00100000:0.0:1788448260.547694:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002faf9726 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216448:12345-0@lo:503: Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.547701:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788448260.547782:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216448:0@lo:503: 00000040:00080000:1.0:1788448260.548075:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448260.548141:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216576:0@lo:502: 00000100:00100000:1.0:1788448260.548192:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.548623:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000158b014e going to sleep for 11 seconds 00000100:00100000:2.0:1788448260.548700:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216576 00000100:00100000:2.0:1788448260.548706:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216576 00000100:00100000:2.0:1788448260.548735:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448260.548800:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009dcd5427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216576:12345-0@lo:502: 00000100:00100000:2.0:1788448260.548920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009dcd5427 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216576:12345-0@lo:502: Request processed in 178us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.548928:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448260.549092:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216576:0@lo:502: 00000040:00080000:1.0:1788448260.549347:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788448260.549372:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788448260.549385:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788448260.549400:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788448260.549413:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788448260.549423:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788448260.549434:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788448260.549444:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788448260.549454:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788448260.549464:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788448260.549474:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788448260.549484:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788448260.549494:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788448260.549505:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788448260.549516:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788448260.549527:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788448260.549547:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788448260.549558:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788448260.549568:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788448260.549580:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788448260.549591:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788448260.549600:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788448260.549610:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788448260.549622:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788448260.549633:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788448260.549643:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788448260.549654:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788448260.549665:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1788448260.549688:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216704:0@lo:502: 00000100:00100000:1.0:1788448260.549730:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.549970:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 00000000158b014e going to sleep for 11 seconds 00000100:00100000:2.0:1788448260.550144:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216704 00000100:00100000:2.0:1788448260.550149:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216704 00000100:00100000:2.0:1788448260.550187:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448260.550200:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e90ca011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216704:12345-0@lo:502: 00000100:00100000:2.0:1788448260.550296:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e90ca011 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216704:12345-0@lo:502: Request processed in 97us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.550304:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788448260.550543:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216704:0@lo:502: 00000040:00080000:1.0:1788448260.550588:0:7447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788448260.550597:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1788448260.551292:0:7465:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788448260.551308:0:7465:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000913732f4) 00000020:00000080:1.0:1788448260.551328:0:7465:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1788448260.551483:0:7465:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b004709 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788448260.551487:0:7465:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009b004709 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788448260.551489:0:7465:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009b004709 3 00010000:00080000:1.0:1788448260.551519:0:7465:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000888b3481@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448260.554448:0:7465:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:1.0:1788448260.554696:0:7465:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788448260.554741:0:7465:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788448260.554813:0:7465:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf45a9e4e6b8033b2 00000100:00080000:1.0:1788448260.554824:0:7465:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448260.554837:0:7465:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000888b3481 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448260.554870:0:7465:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cb3ba540 x1875323826216832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448260.554919:0:7465:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000040:00080000:1.0:1788448260.555124:0:7465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788448260.555471:0:7447:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788448260.555515:0:7447:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448260.555532:0:7447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448260.555543:0:7447:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000005a9d668a/0xf45a9e4e6b80339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788448260.555598:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788448260.555601:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448260.555602:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448260.555603:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448260.555604:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448260.555606:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448260.555607:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448260.555609:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448260.555610:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448260.555611:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448260.555612:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448260.555616:0:7447:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788448260.555618:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448260.555620:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448260.555621:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448260.555622:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448260.555623:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448260.555624:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448260.555625:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448260.555626:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448260.555626:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448260.555627:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448260.555628:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448260.555651:0:7447:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788448260.555663:0:7447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001099a227 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216960:0@lo:253: 00000100:00100000:2.0:1788448260.555726:0:7447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448260.555824:0:7447:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047a053ab going to sleep for 11 seconds 00000100:00100000:2.0:1788448260.555845:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216960 00000100:00100000:2.0:1788448260.555852:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216960 00000100:00100000:2.0:1788448260.555910:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448260.555919:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076394734 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216960:12345-0@lo:253: 20000000:01000000:2.0:1788448260.555942:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788448260.555954:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:1.0:1788448260.556198:0:7466:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000100:00100000:3.0:1788448260.556416:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826216832:0@lo:38: 00000100:00100000:3.0:1788448260.556456:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448260.556525:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826216832 00000100:00100000:2.0:1788448260.556530:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826216832 00000100:00100000:2.0:1788448260.556559:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448260.556563:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f90eab3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826216832:12345-0@lo:38: 00010000:00080000:2.0:1788448260.556581:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:2.0:1788448260.556610:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf45a9e4e6b8033b9 00000004:00100000:2.0:1788448260.556623:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448260.556650:0:6519:0:(import.c:65:import_set_state_nolock()) 000000008de7b1ff : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448260.556736:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f90eab3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875323826216832:12345-0@lo:38: Request processed in 171us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.556743:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788448260.559945:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000cb3ba540 x1875323826216832/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448260.559962:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788448260.560192:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788448260.560208:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788448260.560214:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788448260.560217:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000888b3481 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788448260.560224:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb3ba540 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826216832:0@lo:38: 00000001:00100000:0.0:1788448260.564202:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788448260.564328:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788448260.564406:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788448260.564569:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788448260.564574:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788448260.564591:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.564609:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.564616:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.564622:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.564654:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.564665:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 15 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448260.564677:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051f3dc69 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826217088:0@lo:104: 00000100:00100000:0.0:1788448260.564732:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448260.564840:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.564848:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 15 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448260.564856:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099dafb50 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826217216:0@lo:104: 00000100:00100000:0.0:1788448260.564877:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.564936:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069d4bb0a going to sleep for 11 seconds 00000100:00100000:0.0:1788448260.564957:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217088 00000100:00100000:0.0:1788448260.564964:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217088 00000100:00100000:3.0:1788448260.565108:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217216 00000100:00100000:3.0:1788448260.565113:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217216 00000100:00100000:3.0:1788448260.565141:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448260.565148:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f49718a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826217216:12345-0@lo:104: 00010000:00010000:3.0:1788448260.565171:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448260.565221:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448260.565226:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f49718a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826217216:12345-0@lo:104: Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.565232:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448260.565302:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076394734 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7447:x1875323826216960:12345-0@lo:253: Request processed in 9385us (9577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.565311:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788448260.565834:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448260.565844:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009af6e56f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826217088:12345-0@lo:104: 00010000:00010000:0.0:1788448260.565852:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.565916:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448260.565921:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009af6e56f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826217088:12345-0@lo:104: Request processed in 80us (1189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448260.565927:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788448260.565948:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448260.565954:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.565962:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eb9433ac already unused, calling callback (000000005d7e8dd7) 10000000:00010000:0.0:1788448260.565965:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.565973:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448260.566109:0:7447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001099a227 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7447:1875323826216960:0@lo:253: 10000000:01000000:3.0:1788448260.566123:0:7447:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788448260.566126:0:7447:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788448260.566128:0:7447:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788448260.566129:0:7447:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448260.566130:0:7447:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448260.566132:0:7447:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448260.566133:0:7447:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448260.566135:0:7447:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448260.566143:0:7447:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448260.566144:0:7447:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448260.566145:0:7447:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448260.566147:0:7447:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788448260.566227:0:7447:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788448260.566543:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051f3dc69 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826217088:0@lo:104: 00000100:00100000:1.0:1788448260.566555:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099dafb50 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826217216:0@lo:104: 00010000:00010000:1.0:1788448260.566571:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448260.566617:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448260.566623:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448260.566664:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.566670:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448260.566693:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.566699:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 00000000eb9433ac/0xf45a9e4e6b8032d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.566712:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448260.566714:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.566720:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000085281ba1 already unused, calling callback (000000005d7e8dd7) 10000000:00010000:0.0:1788448260.566722:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.566727:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448260.566732:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448260.566737:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448260.568107:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.568121:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448260.568140:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.568146:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 0000000085281ba1/0xf45a9e4e6b803381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803388 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448260.568223:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448260.568233:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448260.568235:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448260.568243:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448260.568251:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448260.568268:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826217344:0@lo:103: 00000100:00100000:0.0:1788448260.568819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.568903:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074ff2667 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826217472:0@lo:103: 00000100:00100000:0.0:1788448260.568932:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.569270:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217344 00000100:00100000:0.0:1788448260.569293:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217344 00010000:00010000:0.0:1788448260.569324:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 15 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.573259:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217472 00080000:10000000:3.0:1788448260.573266:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00000100:00100000:1.0:1788448260.573271:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217472 00010000:00010000:1.0:1788448260.573314:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 16 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448260.573344:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448260.573353:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e77dd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3645:x1875323826217344:12345-0@lo:103: 00010000:00010000:1.0:1788448260.573365:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448260.573371:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 16 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573393:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 16 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573408:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000576fb72b/0xf45a9e4e6b8032e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8032d9 expref: 16 pid: 6509 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573422:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00080000:10000000:3.0:1788448260.573437:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:1.0:1788448260.573502:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e77dd4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3645:x1875323826217344:12345-0@lo:103: Request processed in 149us (4684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.573510:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448260.573530:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448260.573536:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1273120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:3647:x1875323826217472:12345-0@lo:103: 00010000:00010000:1.0:1788448260.573543:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448260.573547:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 14 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573557:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 14 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573566:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000054a6adf8/0xf45a9e4e6b803388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803381 expref: 14 pid: 6511 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573577:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573584:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448260.573597:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009023884s 00010000:00010000:1.0:1788448260.573601:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573607:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573613:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788448260.573617:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:1.0:1788448260.573628:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573633:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a231938d already unused, calling callback (00000000eede70fe) 00010000:00010000:1.0:1788448260.573637:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573644:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573658:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.573668:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448260.573696:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1273120 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:3647:x1875323826217472:12345-0@lo:103: Request processed in 161us (4764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.573704:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00080000:10000000:3.0:1788448260.573793:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788448260.574014:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788448260.574171:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:1.0:1788448260.575073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826217344:0@lo:103: 00000100:00100000:1.0:1788448260.575173:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074ff2667 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826217472:0@lo:103: 00010000:00010000:1.0:1788448260.575193:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.575202:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448260.575208:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a231938d/0xf45a9e4e6b8033c0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788448260.575584:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788448260.575848:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788448260.576075:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788448260.576308:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788448260.576484:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788448260.576656:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788448260.580581:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788448260.580649:0:7470:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788448260.580654:0:7470:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788448260.580924:0:7471:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:1.0:1788448260.580971:0:7471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875323826217600:0@lo:700: 00000100:00100000:1.0:1788448260.581059:0:7471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.581100:0:7471:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096e47301 going to sleep for 11 seconds 00000040:01000000:3.0:1788448260.581293:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788448260.581486:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217600 00000100:00100000:0.0:1788448260.581495:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217600 00000100:00100000:0.0:1788448260.581545:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448260.581553:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a36b69fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1875323826217600:12345-0@lo:700: 00000100:00100000:0.0:1788448260.582054:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005752174f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826217728:0@lo:1000: 00000100:00100000:0.0:1788448260.582097:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.582133:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bff819f going to sleep for 11 seconds 00000100:00100000:1.0:1788448260.582301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217728 00000100:00100000:1.0:1788448260.582307:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217728 00000100:00100000:1.0:1788448260.582414:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448260.582422:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000adde3769 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826217728:12345-0@lo:1000: 00000100:00100000:1.0:1788448260.582493:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000adde3769 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826217728:12345-0@lo:1000: Request processed in 72us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.582500:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448260.582568:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005752174f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826217728:0@lo:1000: 00000040:01000000:0.0:1788448260.582595:0:7472:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1788448260.582616:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005752174f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826217856:0@lo:700: 00000100:00100000:0.0:1788448260.582644:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788448260.583106:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1788448260.583341:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000419ef0fd going to sleep for 11 seconds 00000040:00080000:3.0:1788448260.583495:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788448260.584036:0:7447:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788448260.584046:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788448260.584588:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:0.0:1788448260.587566:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000040:00080000:3.0:1788448260.588623:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788448260.590583:0:7447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788448260.590647:0:7447:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:1.0:1788448260.591260:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217856 00000100:00100000:1.0:1788448260.591270:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217856 00000100:00100000:3.0:1788448260.591866:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448260.591877:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074ff2667 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826217856:12345-0@lo:700: 00000100:00100000:3.0:1788448260.592121:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074ff2667 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826217856:12345-0@lo:700: Request processed in 246us (9475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.592129:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788448260.592855:0:7447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788448260.593854:0:7447:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788448260.596976:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788448260.597953:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788448260.598854:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00000100:00100000:1.0:1788448260.599513:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005752174f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826217856:0@lo:700: 00000100:00100000:1.0:1788448260.599590:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000039859a97 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1875323826217984:0@lo:900: 00000100:00100000:1.0:1788448260.599654:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448260.601710:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c7ea27e4 going to sleep for 11 seconds 00000100:00100000:1.0:1788448260.602112:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a36b69fb pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:7471:x1875323826217600:12345-0@lo:700: Request processed in 20556us (21050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448260.602130:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448260.602601:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826217984 00000100:00100000:2.0:1788448260.602610:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826217984 00100000:10000000:3.0:1788448260.602614:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:2.0:1788448260.602654:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448260.602660:0:6529:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:2.0:1788448260.602661:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ac91214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1875323826217984:12345-0@lo:900: 00000100:00100000:3.0:1788448260.602666:0:6529:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:2.0:1788448260.602728:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ac91214 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7472:x1875323826217984:12345-0@lo:900: Request processed in 67us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448260.602734:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788448260.603276:0:7471:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000020a94d34 x1875323826217600/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788448276 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448260.603302:0:7471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7471:1875323826217600:0@lo:700: 40000000:02000000:1.0:1788448260.603312:0:7471:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1788448260.604846:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788448260.606443:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788448260.606694:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788448260.607584:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00010000:00080000:0.0:1788448260.611014:0:7472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000039859a97 x1875323826217984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448276 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448260.611055:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000039859a97 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7472:1875323826217984:0@lo:900: 00000100:00100000:0.0:1788448260.611185:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826218112:0@lo:1000: 00000100:00100000:0.0:1788448260.611247:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.611311:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 000000003cf14ad8 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.612517:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826218112 00000100:00100000:3.0:1788448260.612529:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826218112 00000100:00100000:3.0:1788448260.612604:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448260.612614:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e77dd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826218112:12345-0@lo:1000: 00000100:00100000:3.0:1788448260.612726:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e77dd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826218112:12345-0@lo:1000: Request processed in 114us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.612733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448260.613556:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826218112:0@lo:1000: 00000004:00080000:0.0:1788448260.613625:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008bff819f with version 0 00000020:00100000:0.0:1788448260.613648:0:7472:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788448260.613654:0:7472:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000084d82aad x1875323826218368/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448260.613671:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826218368:0@lo:1000: 00000100:00100000:0.0:1788448260.613713:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.613759:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d57790e0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.615093:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826218368 00000100:00100000:3.0:1788448260.615102:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826218368 00000100:00100000:3.0:1788448260.615153:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448260.615161:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099dafb50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826218368:12345-0@lo:1000: 00100000:10000000:2.0:1788448260.617608:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788448260.618185:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788448260.618360:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788448260.618501:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788448260.618645:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788448260.621457:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00000001:00080000:2.0:1788448260.626321:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788448260.626625:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099dafb50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826218368:12345-0@lo:1000: Request processed in 11460us (12906us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788448260.626639:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788448260.626801:0:7472:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788448260.626806:0:7472:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788448260.626820:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826218368:0@lo:1000: 00000100:00100000:0.0:1788448260.626948:0:7472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826218496:0@lo:1000: 00000100:00100000:0.0:1788448260.627236:0:7472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448260.627287:0:7472:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b42944f going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.627516:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826218496 00000100:00100000:3.0:1788448260.627524:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826218496 00000100:00100000:3.0:1788448260.627568:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448260.627576:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051f3dc69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826218496:12345-0@lo:1000: 00000100:00100000:3.0:1788448260.627638:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051f3dc69 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7472:x1875323826218496:12345-0@lo:1000: Request processed in 64us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448260.627655:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448260.627917:0:7472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7472:1875323826218496:0@lo:1000: 00000040:00080000:0.0:1788448260.627939:0:7472:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788448260.627968:0:7472:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000008bff819f with version 1 00000004:00080000:3.0:1788448260.628076:0:7462:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000582805de version 1 rpc_version 1 00000020:00100000:3.0:1788448260.628094:0:7462:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788448260.628099:0:7462:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ff1e12f6 x1875323826218752/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448260.628114:0:7462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1875323826218752:0@lo:1000: 00000100:00100000:3.0:1788448260.628141:0:7462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448260.628225:0:7462:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b1c3e7c going to sleep for 11 seconds 00000100:00100000:3.0:1788448260.628239:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826218752 00000100:00100000:3.0:1788448260.628243:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826218752 00000100:00100000:3.0:1788448260.628271:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448260.628277:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d6ae45c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875323826218752:12345-0@lo:1000: 00000040:00080000:0.0:1788448260.631781:0:7472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788448260.631871:0:7472:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1788448260.632334:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788448260.634522:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788448260.634845:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788448260.635156:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788448260.635409:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788448260.635540:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788448260.635673:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788448260.635815:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00000040:00080000:1.0:1788448260.637408:0:7471:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788448260.638783:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:0.0:1788448260.639040:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d6ae45c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7462:x1875323826218752:12345-0@lo:1000: Request processed in 10759us (10894us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788448260.639061:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1788448260.639511:0:7462:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788448260.639516:0:7462:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788448260.639530:0:7462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ff1e12f6 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7462:1875323826218752:0@lo:1000: 00100000:10000000:3.0:1788448260.639765:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788448260.642635:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788448260.643139:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788448260.643472:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788448260.643625:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788448260.643856:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788448260.644247:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788448260.644479:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788448260.644644:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788448260.645005:0:7447:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788448260.645273:0:7447:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788448260.647584:0:7471:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788448260.647669:0:7471:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788448260.647674:0:7471:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00080000:3.0:1788448260.654502:0:7447:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788448260.654544:0:7447:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbf8c01dcf988 00100000:10000000:3.0:1788448260.654563:0:7447:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1788448260.655834:0:7447:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788448260.655871:0:7447:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788448260.656095:0:7447:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788448260.656114:0:7447:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:3.0:1788448260.657946:0:7447:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448260.658821:0:7447:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788448261.119602:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448262.152699:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448263.172388:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448264.190397:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448265.216187:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788448265.784276:0:7717:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788448265.918176:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448265.918199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547fecad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826218880:0@lo:41: 00000100:00100000:2.0:1788448265.921423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea05efdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826219008:0@lo:400: 00000100:00100000:2.0:1788448265.921496:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448265.921549:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448265.921555:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a2a722a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826219136:0@lo:400: 00000100:00100000:2.0:1788448265.921581:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448265.921605:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003f86b17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826219392:0@lo:400: 00000100:00100000:2.0:1788448265.921666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448265.921683:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448265.921689:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041264683 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826219264:0@lo:400: 00000100:00100000:2.0:1788448265.921740:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448265.921773:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219008 00000100:00100000:2.0:1788448265.921779:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219008 00000100:00100000:2.0:1788448265.921828:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448265.921836:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebb4e356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:3645:x1875323826219008:12345-0@lo:400: 00000100:00100000:2.0:1788448265.921899:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebb4e356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:3645:x1875323826219008:12345-0@lo:400: Request processed in 46us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448265.921906:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448265.921936:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219136 00000100:00100000:2.0:1788448265.921939:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219136 00000100:00100000:3.0:1788448265.922101:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448265.922139:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219264 00000100:00100000:3.0:1788448265.922142:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219264 00000100:00100000:3.0:1788448265.922160:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826218880 00000100:00100000:3.0:1788448265.922162:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826218880 00000100:00100000:3.0:1788448265.922170:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448265.922175:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f72bc18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875323826219264:12345-0@lo:400: 00000100:00100000:3.0:1788448265.922213:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f72bc18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3648:x1875323826219264:12345-0@lo:400: Request processed in 38us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448265.922219:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448265.922231:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448265.922235:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e45dacc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826218880:12345-0@lo:41: 00000004:00000024:3.0:1788448265.922268:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788448265.922295:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e45dacc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826218880:12345-0@lo:41: Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448265.922301:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448265.922332:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547fecad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826218880:0@lo:41: 00000100:00100000:2.0:1788448265.922393:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219392 00000100:00100000:2.0:1788448265.922397:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219392 00000100:00100000:2.0:1788448265.922411:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448265.922416:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028639171 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826219136:12345-0@lo:400: 00000100:00100000:2.0:1788448265.922443:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028639171 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826219136:12345-0@lo:400: Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448265.922448:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448265.922457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448265.922462:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b84f8fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826219392:12345-0@lo:400: 00000100:00100000:2.0:1788448265.922482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b84f8fbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826219392:12345-0@lo:400: Request processed in 20us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448265.922486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448265.922709:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041264683 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826219264:0@lo:400: 00010000:00080000:2.0:1788448265.922721:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000003f86b17 x1875323826219392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448265.922732:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003f86b17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826219392:0@lo:400: 00010000:00080000:2.0:1788448265.922755:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009a2a722a x1875323826219136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448265.922763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a2a722a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826219136:0@lo:400: 00000100:00100000:2.0:1788448265.922779:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea05efdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826219008:0@lo:400: 00010000:00010000:0.0:1788448266.238228:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788448266.717414:0:7770:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448266.717604:0:7770:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448267.265313:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448267.968067:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788448267.968076:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc19ea22000 from 4 10000000:01000000:1.0:1788448267.968082:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448267.968127:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.968140:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.968151:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.968294:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219520:0@lo:101: 00000100:00100000:1.0:1788448267.968369:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448267.968510:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219520 00000100:00100000:3.0:1788448267.968532:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219520 00000100:00100000:3.0:1788448267.968589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448267.968597:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d371ffcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:6514:x1875323826219520:12345-0@lo:101: 00010000:00010000:3.0:1788448267.968610:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448267.968623:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ec339ecf/0xf45a9e4e6b8033ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8033c7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448267.968645:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ec339ecf/0xf45a9e4e6b8033ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448267.968654:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ec339ecf/0xf45a9e4e6b8033ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448267.968673:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ec339ecf, rc 0) 00000100:00100000:3.0:1788448267.968710:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d371ffcc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:6514:x1875323826219520:12345-0@lo:101: Request processed in 114us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448267.968716:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448267.968863:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032e163ec going to sleep for 11 seconds 00000100:00100000:1.0:1788448267.968906:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219520:0@lo:101: 00010000:00010000:1.0:1788448267.968929:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.968947:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.968992:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219648:0@lo:256: 00000100:00100000:1.0:1788448267.969024:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448267.969094:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219648 00000100:00100000:2.0:1788448267.969099:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219648 00000100:00100000:2.0:1788448267.969127:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448267.969133:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ed912b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:6514:x1875323826219648:12345-0@lo:256: 20000000:01000000:2.0:1788448267.969147:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448267.969173:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448267.969176:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788448267.969266:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ed912b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:6514:x1875323826219648:12345-0@lo:256: Request processed in 132us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448267.969272:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788448267.970248:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032e163ec going to sleep for 11 seconds 00000100:00100000:1.0:1788448267.970274:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219648:0@lo:256: 10000000:01000000:1.0:1788448267.970327:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788448267.970335:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.970344:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000850820e9/0xf45a9e4e6b8033c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448267.970353:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788448267.970355:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc190ac6000 from 21 10000000:01000000:1.0:1788448267.970358:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788448267.970385:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.970390:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.970397:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.970411:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219776:0@lo:101: 00000100:00100000:1.0:1788448267.970461:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.970488:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2e82cce going to sleep for 11 seconds 00000100:00100000:2.0:1788448267.970553:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219776 00000100:00100000:2.0:1788448267.970559:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219776 00000100:00100000:2.0:1788448267.970636:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788448267.970644:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c18bda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:6514:x1875323826219776:12345-0@lo:101: 00010000:00010000:2.0:1788448267.970654:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448267.970933:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c8a549a/0xf45a9e4e6b8033dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8033d5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448267.970955:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c8a549a/0xf45a9e4e6b8033dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448267.970965:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c8a549a/0xf45a9e4e6b8033dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448267.970972:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c8a549a, rc 0) 00000100:00100000:2.0:1788448267.971013:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c18bda9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826219776:12345-0@lo:101: Request processed in 371us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448267.971027:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448267.971550:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219776:0@lo:101: 00010000:00010000:1.0:1788448267.971566:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.971575:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.971635:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219904:0@lo:501: 00000100:00100000:1.0:1788448267.971680:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.971703:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2e82cce going to sleep for 11 seconds 00000100:00100000:0.0:1788448267.971934:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826219904 00000100:00100000:0.0:1788448267.971941:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826219904 00000100:00100000:0.0:1788448267.971980:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788448267.971987:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006e225d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826219904:12345-0@lo:501: 00000100:00100000:0.0:1788448267.972118:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006e225d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826219904:12345-0@lo:501: Request processed in 131us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448267.972124:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788448267.972319:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826219904:0@lo:501: 00000100:00100000:1.0:1788448267.972345:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220032:0@lo:503: 00000100:00100000:1.0:1788448267.972383:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.972407:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d2e82cce going to sleep for 11 seconds 00000100:00100000:3.0:1788448267.972471:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220032 00000100:00100000:3.0:1788448267.972475:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220032 00000100:00100000:3.0:1788448267.972493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448267.972498:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039175bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826220032:12345-0@lo:503: 00000100:00100000:3.0:1788448267.972566:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039175bc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826220032:12345-0@lo:503: Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448267.972573:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788448267.972741:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220032:0@lo:503: 00000100:00100000:1.0:1788448267.973480:0:7822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7822:1875323826220160:0@lo:502: 00000100:00100000:1.0:1788448267.973519:0:7822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.973546:0:7822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017677184 going to sleep for 11 seconds 00000100:00100000:3.0:1788448267.973592:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220160 00000100:00100000:3.0:1788448267.973597:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220160 00000100:00100000:3.0:1788448267.973616:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448267.973620:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e6f71bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7822:x1875323826220160:12345-0@lo:502: 00000100:00100000:3.0:1788448267.973722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e6f71bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7822:x1875323826220160:12345-0@lo:502: Request processed in 101us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448267.973748:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788448267.974466:0:7822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7822:1875323826220160:0@lo:502: 00000100:00100000:1.0:1788448267.974523:0:7822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7822:1875323826220288:0@lo:502: 00000100:00100000:1.0:1788448267.974564:0:7822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.974597:0:7822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017677184 going to sleep for 11 seconds 00000100:00100000:0.0:1788448267.974673:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220288 00000100:00100000:0.0:1788448267.974679:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220288 00000100:00100000:0.0:1788448267.974705:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448267.974712:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000991c7a6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7822:x1875323826220288:12345-0@lo:502: 00000100:00100000:0.0:1788448267.974975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000991c7a6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:7822:x1875323826220288:12345-0@lo:502: Request processed in 264us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448267.974983:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448267.975182:0:7822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7822:1875323826220288:0@lo:502: 00000040:00080000:1.0:1788448267.975207:0:7822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788448267.975417:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788448267.975437:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448267.975447:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448267.975456:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000dff4bf4a/0xf45a9e4e6b8033d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448267.975464:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788448267.975467:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc190ac6000 from 4 10000000:01000000:3.0:1788448267.975470:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448267.975496:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448267.975502:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448267.975509:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448267.975520:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547fecad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220416:0@lo:101: 00000100:00100000:3.0:1788448267.975552:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448267.975581:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000007494497a going to sleep for 11 seconds 00000100:00100000:0.0:1788448267.975632:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220416 00000100:00100000:0.0:1788448267.975637:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220416 00000100:00100000:0.0:1788448267.975771:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448267.975785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013b42523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826220416:12345-0@lo:101: 00010000:00010000:0.0:1788448267.975794:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448267.975805:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006582cad3/0xf45a9e4e6b8033ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8033e3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448267.975823:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006582cad3/0xf45a9e4e6b8033ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448267.975832:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006582cad3/0xf45a9e4e6b8033ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448267.975839:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006582cad3, rc 0) 00000100:00100000:0.0:1788448267.975902:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013b42523 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826220416:12345-0@lo:101: Request processed in 118us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448267.975908:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788448267.980958:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547fecad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220416:0@lo:101: 00010000:00010000:1.0:1788448267.980989:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.981000:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.981082:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220544:0@lo:256: 00000100:00100000:1.0:1788448267.981140:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.981290:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017677184 going to sleep for 11 seconds 00000100:00100000:2.0:1788448267.981362:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220544 00000100:00100000:2.0:1788448267.981369:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220544 00000100:00100000:2.0:1788448267.981410:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788448267.981419:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9f2c6bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826220544:12345-0@lo:256: 20000000:01000000:2.0:1788448267.981437:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448267.981453:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448267.981456:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788448267.981546:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9f2c6bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826220544:12345-0@lo:256: Request processed in 128us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448267.981554:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788448267.985793:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220544:0@lo:256: 10000000:01000000:1.0:1788448267.985864:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788448267.985876:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.985901:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000a6d7ed82/0xf45a9e4e6b8033e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448267.985909:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788448267.985912:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788448267.985915:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788448267.985946:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.985953:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.985975:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.985991:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220672:0@lo:101: 00000100:00100000:1.0:1788448267.986051:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.986092:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017677184 going to sleep for 11 seconds 00000100:00100000:2.0:1788448267.986969:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220672 00000100:00100000:2.0:1788448267.986979:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220672 00000100:00100000:2.0:1788448267.987042:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788448267.987052:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f97e9841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826220672:12345-0@lo:101: 00010000:00010000:2.0:1788448267.987064:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448267.987077:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb9433ac/0xf45a9e4e6b8033f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8033f1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448267.987099:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb9433ac/0xf45a9e4e6b8033f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448267.987109:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb9433ac/0xf45a9e4e6b8033f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448267.987117:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb9433ac, rc 0) 00000100:00100000:2.0:1788448267.987175:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f97e9841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826220672:12345-0@lo:101: Request processed in 125us (1124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448267.987194:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448267.988448:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220672:0@lo:101: 00010000:00010000:1.0:1788448267.988471:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448267.988482:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448267.988560:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220800:0@lo:501: 00000100:00100000:1.0:1788448267.988603:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448267.988643:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017677184 going to sleep for 11 seconds 00000100:00100000:2.0:1788448267.989069:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220800 00000100:00100000:2.0:1788448267.989076:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220800 00000100:00100000:2.0:1788448267.989358:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788448267.989369:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d07afce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826220800:12345-0@lo:501: 00000100:00100000:2.0:1788448267.989536:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d07afce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826220800:12345-0@lo:501: Request processed in 169us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448267.989544:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448267.989616:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020a94d34 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220800:0@lo:501: 00000100:00100000:0.0:1788448267.989652:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220928:0@lo:503: 00000100:00100000:0.0:1788448267.989706:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448267.992955:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b1595ff going to sleep for 11 seconds 00000100:00100000:1.0:1788448267.999516:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826220928 00000100:00100000:1.0:1788448267.999532:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826220928 00000100:00100000:0.0:1788448267.999685:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788448267.999695:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067c5bbab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826220928:12345-0@lo:503: 00000100:00100000:0.0:1788448267.999911:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067c5bbab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826220928:12345-0@lo:503: Request processed in 187us (10175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448267.999920:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448268.000334:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826220928:0@lo:503: 00000100:00100000:1.0:1788448268.007125:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5cd2d0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7823:1875323826221056:0@lo:502: 00000100:00100000:0.0:1788448268.008091:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.008133:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000017677184 going to sleep for 11 seconds 00000100:00100000:1.0:1788448268.008917:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221056 00000100:00100000:1.0:1788448268.008928:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221056 00000100:00100000:1.0:1788448268.008973:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448268.008982:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009d528a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:7823:x1875323826221056:12345-0@lo:502: 00000100:00100000:1.0:1788448268.009323:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009d528a70 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:7823:x1875323826221056:12345-0@lo:502: Request processed in 341us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448268.009339:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448268.010060:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5cd2d0f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7823:1875323826221056:0@lo:502: 00000020:01000000:0.0:1788448268.010103:0:7823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448268.010114:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448268.010116:0:7823:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788448268.010122:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788448268.010125:0:7823:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:00000080:0.0:1788448268.010148:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448268.010184:0:7823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000066cea58a) 00000020:00000080:0.0:1788448268.010204:0:7823:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1788448268.010211:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788448268.010309:0:7823:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788448268.010315:0:7823:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788448268.010322:0:7823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b803406 00010000:00080000:0.0:1788448268.010349:0:7823:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a3c8cc7f@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448268.012045:0:7823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788448268.019304:0:7823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448268.019320:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788448268.019360:0:7823:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788448268.019379:0:7823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b80340d 00000100:00080000:2.0:1788448268.019389:0:7823:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448268.019394:0:7823:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a3c8cc7f using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448268.019429:0:7823:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ea05efdb x1875323826221184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448268.019457:0:7823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788448268.019498:0:7823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788448268.019766:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ea05efdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826221184:0@lo:38: 00000100:00100000:3.0:1788448268.019836:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448268.020538:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5bc87ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826221440:0@lo:400: 00000100:00100000:1.0:1788448268.020574:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448268.020641:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448268.020647:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027e6f9bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826221312:0@lo:400: 00000100:00100000:1.0:1788448268.020686:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448268.020710:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007bf9ffc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826221568:0@lo:400: 00000100:00100000:1.0:1788448268.020984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448268.021023:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221184 00000100:00100000:1.0:1788448268.021042:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221184 00000100:00100000:1.0:1788448268.021068:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221440 00000100:00100000:1.0:1788448268.021071:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221440 00000100:00100000:1.0:1788448268.021094:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448268.021100:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fe32ce5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826221184:12345-0@lo:38: 00010000:00080000:1.0:1788448268.021124:0:6523:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:1.0:1788448268.021158:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b803414 00000004:00100000:1.0:1788448268.021349:0:6523:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788448268.021355:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1788448268.021427:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221312 00000100:00100000:1.0:1788448268.021431:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221312 00000100:00100000:1.0:1788448268.021459:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221568 00000100:00100000:1.0:1788448268.021462:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221568 00000100:00100000:1.0:1788448268.021476:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448268.021482:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000599b60f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826221312:12345-0@lo:400: 00000100:00100000:1.0:1788448268.021532:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000599b60f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826221312:12345-0@lo:400: Request processed in 51us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448268.021538:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448268.021567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448268.021573:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef926d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826221568:12345-0@lo:400: 00000100:00100000:1.0:1788448268.021606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef926d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826221568:12345-0@lo:400: Request processed in 33us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448268.021611:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788448268.021649:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000027e6f9bc x1875323826221312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448268.022516:0:7826:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000004200f2e2 x1875323826221696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448268.022529:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 000000007494497a going to sleep for 0 seconds 00000020:01000000:2.0:1788448268.022653:0:7823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448268.022660:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448268.022671:0:7823:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788448268.022676:0:7823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448268.022680:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448268.022681:0:7823:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448268.022685:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448268.022686:0:7823:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788448268.022707:0:7823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a2a722a pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7823:1875323826221824:0@lo:502: 00000100:00100000:2.0:1788448268.022765:0:7823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448268.022815:0:7823:0:(client.c:2715:ptlrpc_set_wait()) set 0000000053c41aa2 going to sleep for 11 seconds 00000100:00100000:3.0:1788448268.022948:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221824 00000100:00100000:3.0:1788448268.022955:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221824 00000100:00100000:3.0:1788448268.022998:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448268.023005:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f5cbf3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:7823:x1875323826221824:12345-0@lo:502: 00000100:00100000:3.0:1788448268.023118:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f5cbf3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:7823:x1875323826221824:12345-0@lo:502: Request processed in 114us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448268.023126:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788448268.023385:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027e6f9bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826221312:0@lo:400: 00010000:00080000:1.0:1788448268.023429:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007bf9ffc7 x1875323826221568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448268.023439:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007bf9ffc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826221568:0@lo:400: 00000100:00100000:2.0:1788448268.023671:0:7823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a2a722a pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:7823:1875323826221824:0@lo:502: 00000020:01000000:2.0:1788448268.023697:0:7823:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448268.023703:0:7823:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448268.023704:0:7823:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788448268.023709:0:7823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788448268.023909:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788448268.023928:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788448268.023936:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448268.023946:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 000000003e19b33a/0xf45a9e4e6b8033f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448268.023955:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788448268.023957:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc19ebe99b8 from 1 10000000:01000000:0.0:1788448268.023960:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788448268.023984:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448268.023990:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448268.024011:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448268.024025:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfad9ecf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826221952:0@lo:101: 00000100:00100000:0.0:1788448268.024510:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.024691:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb76fe5a going to sleep for 11 seconds 00000100:00100000:3.0:1788448268.034555:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221952 00000100:00100000:3.0:1788448268.034570:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221952 00000100:00100000:3.0:1788448268.035650:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448268.035663:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000830874c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826221952:12345-0@lo:101: 00010000:00010000:3.0:1788448268.035681:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448268.035697:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ead6598/0xf45a9e4e6b803422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80341b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448268.035722:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ead6598/0xf45a9e4e6b803422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448268.035733:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ead6598/0xf45a9e4e6b803422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448268.035741:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ead6598, rc 0) 00000100:00100000:3.0:1788448268.035831:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000830874c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826221952:12345-0@lo:101: Request processed in 170us (11321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448268.035837:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448268.035984:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfad9ecf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826221952:0@lo:101: 00010000:00010000:0.0:1788448268.036001:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448268.036010:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448268.036077:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dfad9ecf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826222080:0@lo:501: 00000100:00100000:0.0:1788448268.036108:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.036155:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb76fe5a going to sleep for 11 seconds 00000100:00100000:3.0:1788448268.036580:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222080 00000100:00100000:3.0:1788448268.036588:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222080 00000100:00100000:0.0:1788448268.036699:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448268.036706:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8dfaee1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826222080:12345-0@lo:501: 00000100:00100000:0.0:1788448268.036784:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8dfaee1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826222080:12345-0@lo:501: Request processed in 79us (675us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448268.036802:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448268.036835:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dfad9ecf pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826222080:0@lo:501: 10000000:01000000:0.0:1788448268.036864:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788448268.036871:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448268.036915:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: 00000000a231938d/0xf45a9e4e6b80341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788448268.038340:0:6523:0:(import.c:65:import_set_state_nolock()) 000000004bb7f47d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448268.038485:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fe32ce5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826221184:12345-0@lo:38: Request processed in 17383us (18648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448268.038499:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448268.038528:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448268.038536:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a89ea92b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826221440:12345-0@lo:400: 00000100:00100000:2.0:1788448268.038595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a89ea92b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826221440:12345-0@lo:400: Request processed in 61us (18021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448268.038601:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448268.038842:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5bc87ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826221440:0@lo:400: 00000100:00100000:3.0:1788448268.039085:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788448268.039094:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788448268.039111:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788448268.041093:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788448268.041097:0:3644:0:(import.c:65:import_set_state_nolock()) 00000000a3c8cc7f lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788448268.041207:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007494497a): req@000000004200f2e2 x1875323826221696/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448268.041232:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ea05efdb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826221184:0@lo:38: 00000100:00100000:0.0:1788448268.041458:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.041505:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 000000007494497a going to sleep for 11 seconds 00000100:00100000:3.0:1788448268.041559:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826221696 00000100:00100000:3.0:1788448268.041571:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826221696 00000100:00100000:3.0:1788448268.041662:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448268.041670:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfad9ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826221696:12345-0@lo:1000: 00000100:00100000:3.0:1788448268.041754:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfad9ecf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826221696:12345-0@lo:1000: Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448268.041762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448268.041832:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826221696:0@lo:1000: 00000040:01000000:0.0:1788448268.041861:0:7826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788448268.041919:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000672a327b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222208:0@lo:1000: 00000100:00100000:0.0:1788448268.041949:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.042825:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2fd03b2 going to sleep for 11 seconds 00000100:00100000:0.0:1788448268.042986:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009a2a722a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826222336:0@lo:41: 00000100:00100000:0.0:1788448268.043026:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448268.043061:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222208 00000100:00100000:1.0:1788448268.043067:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222208 00000100:00100000:1.0:1788448268.043108:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448268.043127:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cb56357 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222208:12345-0@lo:1000: 00000100:00100000:1.0:1788448268.043459:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cb56357 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222208:12345-0@lo:1000: Request processed in 344us (1508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448268.043467:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448268.043534:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000672a327b pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222208:0@lo:1000: 00000100:00100000:2.0:1788448268.043585:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000003f86b17 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222464:0@lo:700: 00000100:00100000:2.0:1788448268.043612:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448268.043736:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 000000002768cbc3 going to sleep for 11 seconds 00000100:00100000:2.0:1788448268.043984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222336 00000100:00100000:2.0:1788448268.043990:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222336 00000100:00100000:2.0:1788448268.044013:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448268.044019:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d17f8b9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826222336:12345-0@lo:41: 00000004:00000024:2.0:1788448268.044041:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788448268.044084:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d17f8b9c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826222336:12345-0@lo:41: Request processed in 66us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448268.044090:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448268.044333:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009a2a722a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826222336:0@lo:41: 00000100:00100000:1.0:1788448268.044400:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222464 00000100:00100000:1.0:1788448268.044405:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222464 00000100:00100000:1.0:1788448268.044469:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448268.044476:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041264683 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222464:12345-0@lo:700: 00000100:00100000:1.0:1788448268.044528:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041264683 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222464:12345-0@lo:700: Request processed in 53us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448268.044543:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448268.044602:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000003f86b17 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222464:0@lo:700: 00000100:00100000:0.0:1788448268.044774:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222592:0@lo:1000: 00000100:00100000:0.0:1788448268.044818:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.044845:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000054fd8530 going to sleep for 11 seconds 00000100:00100000:3.0:1788448268.045051:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222592 00000100:00100000:3.0:1788448268.045056:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222592 00000100:00100000:3.0:1788448268.045089:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448268.045094:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003961930d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222592:12345-0@lo:1000: 00000100:00100000:3.0:1788448268.045165:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003961930d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222592:12345-0@lo:1000: Request processed in 71us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448268.045171:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448268.045208:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222592:0@lo:1000: 00000004:00080000:3.0:1788448268.045261:0:7826:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000a1cdc2ad with version 0 00000020:00100000:3.0:1788448268.045275:0:7826:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788448268.045282:0:7826:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004200f2e2 x1875323826222848/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448268.045295:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222848:0@lo:1000: 00000100:00100000:3.0:1788448268.045328:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448268.045347:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222848 00000100:00100000:3.0:1788448268.045351:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222848 00000100:00100000:3.0:1788448268.045367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448268.045371:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000547fecad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7826:x1875323826222848:12345-0@lo:1000: 00000100:00100000:3.0:1788448268.049505:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 0000000057177732 going to sleep for 11 seconds 00000001:00080000:3.0:1788448268.051197:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788448268.051210:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788448268.053082:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000547fecad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7826:x1875323826222848:12345-0@lo:1000: Request processed in 7702us (7745us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788448268.053097:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788448268.053285:0:7826:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1788448268.053291:0:7826:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788448268.053305:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222848:0@lo:1000: 00000100:00100000:3.0:1788448268.053392:0:7826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222976:0@lo:1000: 00000100:00100000:3.0:1788448268.053430:0:7826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448268.053486:0:7826:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e11a54c going to sleep for 11 seconds 00000100:00100000:0.0:1788448268.053532:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826222976 00000100:00100000:0.0:1788448268.053538:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826222976 00000100:00100000:0.0:1788448268.053615:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448268.053687:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ff1e12f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7826:x1875323826222976:12345-0@lo:1000: 00000100:00100000:0.0:1788448268.053762:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ff1e12f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7826:x1875323826222976:12345-0@lo:1000: Request processed in 140us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448268.053777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448268.053875:0:7826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004200f2e2 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7826:1875323826222976:0@lo:1000: 00000040:00080000:1.0:1788448268.053926:0:7826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1788448268.053955:0:7826:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000d2e82cce with version 1 00000040:00080000:1.0:1788448268.058900:0:7826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788448268.058982:0:7826:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788448268.058987:0:7826:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:0.0:1788448268.059769:0:7824:0:(osp_trans.c:1336:osp_get_next_request()) ou 000000005b5ba496 version 1 rpc_version 1 00000020:00100000:0.0:1788448268.059858:0:7824:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788448268.059869:0:7824:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000c28b79c0 x1875323826223232/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448268.060011:0:7824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7824:1875323826223232:0@lo:1000: 00000100:00100000:0.0:1788448268.060073:0:7824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448268.061042:0:7824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a2fd03b2 going to sleep for 11 seconds 00000100:00100000:3.0:1788448268.064517:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826223232 00000100:00100000:3.0:1788448268.064532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826223232 00000100:00100000:2.0:1788448268.069996:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448268.070012:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000672a327b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7824:x1875323826223232:12345-0@lo:1000: 00000001:00080000:0.0:1788448268.076019:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:2.0:1788448268.076300:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000672a327b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7824:x1875323826223232:12345-0@lo:1000: Request processed in 6289us (16223us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788448268.076313:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1788448268.076394:0:7824:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788448268.076399:0:7824:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788448268.076416:0:7824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7824:1875323826223232:0@lo:1000: 00010000:00010000:0.0:1788448268.287448:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448269.310794:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448269.576530:0:7876:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448269.581279:0:7876:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788448270.335169:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448270.667782:0:7924:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdab6c26b0 20000000:00000080:2.0:1788448270.667798:0:7924:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc1bb6a6800 uarg=0000000000000000 20000000:01000000:2.0:1788448270.667837:0:7924:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788448270.667845:0:7924:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788448270.667850:0:7924:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788448270.668145:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788448270.668157:0:7924:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788448270.676661:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448270.676968:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788448270.677002:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788448270.677017:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788448270.677032:0:7924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788448270.677049:0:7924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448270.677066:0:7924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448270.677073:0:7924:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448270.677080:0:7924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448270.677116:0:7924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448270.677142:0:7924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448270.677156:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000045fb626d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1875323826223360:0@lo:104: 00000100:00100000:2.0:1788448270.677219:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448270.677374:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788448270.677387:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826223360 00000100:00100000:1.0:1788448270.677394:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826223360 00000100:00100000:1.0:1788448270.677438:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448270.677446:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000662eaee8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:7924:x1875323826223360:12345-0@lo:104: 00010000:00010000:1.0:1788448270.677458:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.677510:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448270.677515:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000662eaee8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:7924:x1875323826223360:12345-0@lo:104: Request processed in 71us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448270.677522:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788448270.677847:0:7924:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448270.677856:0:7924:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 17 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448270.677865:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e47d7595 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1875323826223488:0@lo:104: 00000100:00100000:2.0:1788448270.677975:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448270.678002:0:7924:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d875d18f going to sleep for 11 seconds 00000100:00100000:2.0:1788448270.678020:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000045fb626d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1875323826223360:0@lo:104: 00000100:00100000:1.0:1788448270.678066:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826223488 00000100:00100000:1.0:1788448270.678070:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826223488 00000100:00100000:1.0:1788448270.678105:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448270.678112:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049da1165 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:7924:x1875323826223488:12345-0@lo:104: 00010000:00010000:1.0:1788448270.678120:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678182:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788448270.678188:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049da1165 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:7924:x1875323826223488:12345-0@lo:104: Request processed in 77us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448270.678194:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788448270.678252:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448270.678257:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678264:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000daca2270 already unused, calling callback (000000005d7e8dd7) 10000000:00010000:0.0:1788448270.678267:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678275:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448270.678289:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448270.678304:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448270.678339:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678346:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448270.678363:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678369:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 00000000daca2270/0xf45a9e4e6b80338f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803396 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678383:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448270.678385:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678390:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006fa27297 already unused, calling callback (000000005d7e8dd7) 10000000:00010000:0.0:1788448270.678392:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678398:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448270.678404:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448270.678409:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448270.678420:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678426:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448270.678436:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678442:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: 000000006fa27297/0xf45a9e4e6b8032a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8032a8 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448270.678455:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448270.678456:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448270.678458:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448270.678477:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e47d7595 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7924:1875323826223488:0@lo:104: 00010000:00010000:0.0:1788448270.678497:0:7924:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448270.678613:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826223744:0@lo:103: 00000100:00100000:1.0:1788448270.678642:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448270.678669:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448270.678674:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826223616:0@lo:103: 00000100:00100000:1.0:1788448270.678694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448270.678722:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826223744 00000100:00100000:1.0:1788448270.678726:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826223744 00010000:00010000:1.0:1788448270.678744:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 18 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448270.678762:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826223616 00000100:00100000:1.0:1788448270.678765:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826223616 00010000:00010000:1.0:1788448270.678773:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 19 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448270.678784:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448270.678790:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5bc87ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3646:x1875323826223744:12345-0@lo:103: 00010000:00010000:1.0:1788448270.678800:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448270.678804:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 19 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678812:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 19 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678834:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002a4fbf1c/0xf45a9e4e6b8032a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8032a1 expref: 19 pid: 6509 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678847:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448270.678875:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5bc87ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3646:x1875323826223744:12345-0@lo:103: Request processed in 86us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448270.678907:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448270.678921:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448270.678926:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bf9ffc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:3646:x1875323826223616:12345-0@lo:103: 00010000:00010000:1.0:1788448270.678933:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448270.678936:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678943:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678951:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a0de57c0/0xf45a9e4e6b803396 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80338f expref: 17 pid: 6511 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678959:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678965:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678975:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678980:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678991:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.678996:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.679001:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000daa069fd already unused, calling callback (00000000eede70fe) 00010000:00010000:1.0:1788448270.679004:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.679009:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.679022:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.679030:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448270.679053:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bf9ffc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3646:x1875323826223616:12345-0@lo:103: Request processed in 127us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448270.679059:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448270.679087:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c28b79c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826223616:0@lo:103: 00000100:00100000:1.0:1788448270.679093:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084d82aad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826223744:0@lo:103: 00010000:00010000:1.0:1788448270.679112:0:7924:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.679118:0:7924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448270.679123:0:7924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000daa069fd/0xf45a9e4e6b803429 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448270.683705:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448271.038767:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448271.038792:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005752174f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826223872:0@lo:41: 00000100:00100000:3.0:1788448271.038860:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448271.039157:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826223872 00000100:00100000:0.0:1788448271.039166:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826223872 00000100:00100000:0.0:1788448271.039229:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448271.039240:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006fd361b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826223872:12345-0@lo:41: 00000004:00000024:0.0:1788448271.039271:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788448271.039337:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006fd361b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826223872:12345-0@lo:41: Request processed in 98us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448271.039345:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448271.039402:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005752174f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826223872:0@lo:41: 00010000:00010000:0.0:1788448271.358251:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448272.382234:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448273.088230:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009a746c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826224384:0@lo:400: 00000100:00100000:1.0:1788448273.088326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448273.088399:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788448273.088406:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000027e6f9bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826224000:0@lo:400: 00000100:00100000:1.0:1788448273.088442:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448273.088466:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d5cd2d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826224512:0@lo:400: 00000100:00100000:1.0:1788448273.088495:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448273.091903:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224000 00000100:00100000:0.0:1788448273.091927:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224000 00000100:00100000:0.0:1788448273.092003:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788448273.092014:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007802b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3647:x1875323826224000:12345-0@lo:400: 00000100:00100000:0.0:1788448273.092154:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007802b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3647:x1875323826224000:12345-0@lo:400: Request processed in 142us (3712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448273.092176:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788448273.092241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224512 00000100:00100000:0.0:1788448273.092246:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224512 00000100:00100000:0.0:1788448273.092275:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448273.092282:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039859a97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826224512:12345-0@lo:400: 00000100:00100000:0.0:1788448273.092329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039859a97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826224512:12345-0@lo:400: Request processed in 48us (3834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448273.092336:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448273.094524:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000027e6f9bc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826224000:0@lo:400: 00000100:00100000:1.0:1788448273.094553:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d5cd2d0f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826224512:0@lo:400: 00000100:00100000:1.0:1788448273.094609:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006cb5dcf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826224128:0@lo:400: 00000100:00100000:1.0:1788448273.094690:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448273.094743:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448273.094750:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826224256:0@lo:400: 00000100:00100000:1.0:1788448273.094790:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448273.094831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224384 00000100:00100000:1.0:1788448273.094838:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224384 00000100:00100000:1.0:1788448273.094910:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224128 00000100:00100000:1.0:1788448273.094914:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224128 00000100:00100000:1.0:1788448273.094933:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448273.094941:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020a94d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826224384:12345-0@lo:400: 00000100:00100000:1.0:1788448273.094998:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020a94d34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826224384:12345-0@lo:400: Request processed in 58us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448273.095007:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448273.095026:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448273.095032:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5cd2d0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826224128:12345-0@lo:400: 00000100:00100000:1.0:1788448273.095080:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5cd2d0f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826224128:12345-0@lo:400: Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448273.095087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788448273.095310:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000009a746c6 x1875323826224384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448273.095324:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009a746c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826224384:0@lo:400: 00010000:00080000:1.0:1788448273.095349:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006cb5dcf3 x1875323826224128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448273.095357:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006cb5dcf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826224128:0@lo:400: 00000100:00100000:0.0:1788448273.095454:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224256 00000100:00100000:0.0:1788448273.095459:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224256 00000100:00100000:0.0:1788448273.095484:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448273.095489:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027e6f9bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826224256:12345-0@lo:400: 00000100:00100000:0.0:1788448273.095541:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027e6f9bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826224256:12345-0@lo:400: Request processed in 52us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448273.095547:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448273.096482:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448273.096504:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ad3b7792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826224640:0@lo:41: 00000100:00100000:0.0:1788448273.096560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448273.096602:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224640 00000100:00100000:0.0:1788448273.096608:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224640 00000100:00100000:0.0:1788448273.096640:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448273.096646:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005752174f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826224640:12345-0@lo:41: 00000004:00000024:0.0:1788448273.096693:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788448273.096736:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005752174f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826224640:12345-0@lo:41: Request processed in 90us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448273.096743:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448273.096784:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ad3b7792 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826224640:0@lo:41: 00000100:00100000:1.0:1788448273.099525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826224256:0@lo:400: 00010000:00010000:2.0:1788448273.411279:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448274.431088:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448275.134051:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448275.134064:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc19ea22000 from 1 10000000:01000000:1.0:1788448275.134069:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448275.134132:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: 000000002a4fbf1c/0xf45a9e4e6b803430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448275.134148:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: 000000002a4fbf1c/0xf45a9e4e6b803430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448275.134163:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: 000000002a4fbf1c/0xf45a9e4e6b803430 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448275.134195:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826224768:0@lo:101: 00000100:00100000:1.0:1788448275.134307:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448275.134416:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032e163ec going to sleep for 11 seconds 00000100:00100000:3.0:1788448275.134833:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224768 00000100:00100000:3.0:1788448275.134845:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224768 00000100:00100000:3.0:1788448275.134938:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788448275.134949:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ff9a54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826224768:12345-0@lo:101: 00010000:00010000:3.0:1788448275.134966:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448275.134984:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4b74c5a/0xf45a9e4e6b803437 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803430 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448275.135039:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4b74c5a/0xf45a9e4e6b803437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448275.135050:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4b74c5a/0xf45a9e4e6b803437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448275.135060:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4b74c5a, rc 0) 00000100:00100000:3.0:1788448275.135120:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ff9a54e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826224768:12345-0@lo:101: Request processed in 173us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448275.135127:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788448275.135275:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826224768:0@lo:101: 00010000:00010000:1.0:1788448275.135301:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: 000000002a4fbf1c/0xf45a9e4e6b803430 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448275.135320:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: 000000002a4fbf1c/0xf45a9e4e6b803430 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448275.135411:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826224896:0@lo:501: 00000100:00100000:1.0:1788448275.135569:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448275.135603:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032e163ec going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.135677:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826224896 00000100:00100000:0.0:1788448275.135682:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826224896 00000100:00100000:0.0:1788448275.135716:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788448275.135723:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e536155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826224896:12345-0@lo:501: 00000100:00100000:0.0:1788448275.135878:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e536155 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826224896:12345-0@lo:501: Request processed in 156us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.135923:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448275.136102:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826224896:0@lo:501: 00000100:00100000:1.0:1788448275.136137:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225024:0@lo:503: 00000100:00100000:1.0:1788448275.136185:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448275.136221:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000032e163ec going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.136321:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225024 00000100:00100000:0.0:1788448275.136327:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225024 00000100:00100000:0.0:1788448275.138636:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788448275.138679:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000982e05c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826225024:12345-0@lo:503: 00000100:00100000:0.0:1788448275.138973:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000982e05c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826225024:12345-0@lo:503: Request processed in 310us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.138982:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788448275.143864:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e44769cc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225024:0@lo:503: 00000100:00100000:3.0:1788448275.154626:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a01c250f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8140:1875323826225152:0@lo:502: 00000100:00100000:3.0:1788448275.154961:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448275.155022:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fbdac192 going to sleep for 11 seconds 00000100:00100000:1.0:1788448275.155127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225152 00000100:00100000:1.0:1788448275.155138:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225152 00000100:00100000:1.0:1788448275.155189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448275.155209:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000874d44f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8140:x1875323826225152:12345-0@lo:502: 00000100:00100000:1.0:1788448275.155376:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000874d44f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8140:x1875323826225152:12345-0@lo:502: Request processed in 178us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448275.155385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448275.156569:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a01c250f pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8140:1875323826225152:0@lo:502: 00000020:01000000:3.0:1788448275.156624:0:8140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448275.156821:0:8140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448275.156826:0:8140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788448275.156837:0:8140:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc19ea22000 00000020:00000080:3.0:1788448275.156840:0:8140:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788448275.166934:0:8140:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8140:1875323826225280:0@lo:502: 00000100:00100000:2.0:1788448275.167876:0:8140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448275.168945:0:8140:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc188888cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.183143:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225280 00000100:00100000:0.0:1788448275.183162:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225280 00000100:00100000:1.0:1788448275.183306:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448275.183321:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8140:x1875323826225280:12345-0@lo:502: 00000100:00100000:1.0:1788448275.183552:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8140:x1875323826225280:12345-0@lo:502: Request processed in 234us (15682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448275.183561:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448275.183865:0:8140:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8140:1875323826225280:0@lo:502: 00000020:01000000:2.0:1788448275.183941:0:8140:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448275.183951:0:8140:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448275.183954:0:8140:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788448275.183958:0:8140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788448275.184235:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788448275.184269:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448275.184281:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448275.184306:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448275.184319:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448275.184322:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc190ac6000 from 1 10000000:01000000:1.0:1788448275.184325:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448275.184367:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448275.184376:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448275.184385:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448275.184407:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225408:0@lo:101: 00000100:00100000:1.0:1788448275.184473:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448275.184509:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.184568:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225408 00000100:00100000:0.0:1788448275.184575:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225408 00000100:00100000:0.0:1788448275.184621:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788448275.184632:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826225408:12345-0@lo:101: 00010000:00010000:0.0:1788448275.184645:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448275.184661:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80343e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448275.184688:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448275.184725:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448275.184735:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:0.0:1788448275.184788:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826225408:12345-0@lo:101: Request processed in 158us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.184796:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448275.185080:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225408:0@lo:101: 00010000:00010000:2.0:1788448275.185104:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448275.185114:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448275.185180:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225536:0@lo:501: 00000100:00100000:2.0:1788448275.185228:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448275.185251:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc188888cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.185409:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225536 00000100:00100000:0.0:1788448275.185415:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225536 00000100:00100000:0.0:1788448275.185454:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788448275.185461:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826225536:12345-0@lo:501: 00000100:00100000:0.0:1788448275.185585:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826225536:12345-0@lo:501: Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.185592:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448275.186595:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225536:0@lo:501: 00000100:00100000:2.0:1788448275.186645:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225664:0@lo:503: 00000100:00100000:2.0:1788448275.186700:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448275.186809:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225664 00000100:00100000:0.0:1788448275.186815:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225664 00000100:00100000:0.0:1788448275.186854:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788448275.186863:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826225664:12345-0@lo:503: 00000100:00100000:0.0:1788448275.186995:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826225664:12345-0@lo:503: Request processed in 132us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.187003:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788448275.187127:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc188888cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448275.187139:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826225664:0@lo:503: 00000100:00100000:2.0:1788448275.187793:0:8141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8141:1875323826225792:0@lo:502: 00000100:00100000:2.0:1788448275.188025:0:8141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448275.188089:0:8141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc188888000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.188111:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225792 00000100:00100000:0.0:1788448275.188119:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225792 00000100:00100000:0.0:1788448275.188165:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788448275.188174:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8141:x1875323826225792:12345-0@lo:502: 00000100:00100000:0.0:1788448275.188311:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8141:x1875323826225792:12345-0@lo:502: Request processed in 137us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.188325:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788448275.188409:0:8141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8141:1875323826225792:0@lo:502: 00000020:01000000:3.0:1788448275.188441:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448275.188453:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448275.188456:0:8141:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788448275.188463:0:8141:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc190ac6000 00000020:00000080:3.0:1788448275.188466:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448275.188493:0:8141:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8141:1875323826225920:0@lo:502: 00000100:00100000:3.0:1788448275.188534:0:8141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448275.188573:0:8141:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448275.188621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826225920 00000100:00100000:0.0:1788448275.188626:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826225920 00000100:00100000:0.0:1788448275.188657:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788448275.188664:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8141:x1875323826225920:12345-0@lo:502: 00000100:00100000:0.0:1788448275.188820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8141:x1875323826225920:12345-0@lo:502: Request processed in 156us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448275.188827:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448275.188873:0:8141:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8141:1875323826225920:0@lo:502: 00000020:01000000:3.0:1788448275.188922:0:8141:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448275.188927:0:8141:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448275.188929:0:8141:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788448275.188932:0:8141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788448275.189016:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788448275.189044:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448275.189055:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448275.189067:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448275.455334:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448276.158135:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448276.158171:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826226048:0@lo:41: 00000100:00100000:1.0:1788448276.158275:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448276.158397:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226048 00000100:00100000:0.0:1788448276.158407:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226048 00000100:00100000:0.0:1788448276.158472:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448276.158483:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826226048:12345-0@lo:41: 00000004:00000024:0.0:1788448276.158525:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788448276.158584:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826226048:12345-0@lo:41: Request processed in 102us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448276.158592:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448276.158671:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826226048:0@lo:41: 00010000:00010000:1.0:1788448276.479619:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448277.503395:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448278.206044:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448278.206077:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826226176:0@lo:41: 00000100:00100000:2.0:1788448278.206119:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826226560:0@lo:400: 00000100:00100000:0.0:1788448278.206160:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448278.206248:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826226304:0@lo:400: 00000100:00100000:1.0:1788448278.206259:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826226688:0@lo:400: 00000100:00100000:0.0:1788448278.206281:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448278.206292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448278.206304:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826226816:0@lo:400: 00000100:00100000:0.0:1788448278.206323:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448278.206330:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826226432:0@lo:400: 00000100:00100000:1.0:1788448278.206355:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448278.206355:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226176 00000100:00100000:0.0:1788448278.206363:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226176 00000100:00100000:1.0:1788448278.206381:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226688 00000100:00100000:1.0:1788448278.206385:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226688 00000100:00100000:0.0:1788448278.206402:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226816 00000100:00100000:0.0:1788448278.206405:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226816 00000100:00100000:1.0:1788448278.206410:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226432 00000100:00100000:1.0:1788448278.206412:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226432 00000100:00100000:0.0:1788448278.206419:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448278.206425:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448278.206429:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826226176:12345-0@lo:41: 00000100:00100000:1.0:1788448278.206430:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826226688:12345-0@lo:400: 00000004:00000024:0.0:1788448278.206463:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788448278.206479:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826226688:12345-0@lo:400: Request processed in 48us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448278.206487:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448278.206496:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826226176:12345-0@lo:41: Request processed in 68us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448278.206501:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448278.206503:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448278.206509:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826226432:12345-0@lo:400: 00000100:00100000:0.0:1788448278.206513:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448278.206518:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826226816:12345-0@lo:400: 00000100:00100000:1.0:1788448278.206537:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826226432:12345-0@lo:400: Request processed in 28us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448278.206541:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826226816:12345-0@lo:400: Request processed in 23us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448278.206543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448278.206546:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448278.206563:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226304 00000100:00100000:0.0:1788448278.206580:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226304 00010000:00080000:1.0:1788448278.206587:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1ba1f3800 x1875323826226432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448278.206602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826226432:0@lo:400: 00000100:00100000:0.0:1788448278.206606:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448278.206611:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3648:x1875323826226304:12345-0@lo:400: 00010000:00080000:1.0:1788448278.206633:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1ba1f0380 x1875323826226688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448278.206638:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3648:x1875323826226304:12345-0@lo:400: Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448278.206642:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826226688:0@lo:400: 00000100:00100000:0.0:1788448278.206645:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448278.206678:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826226304:0@lo:400: 00000100:00100000:0.0:1788448278.206695:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826226816:0@lo:400: 00000100:00100000:0.0:1788448278.206707:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826226176:0@lo:41: 00000100:00100000:2.0:1788448278.206708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448278.206782:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226560 00000100:00100000:1.0:1788448278.206787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226560 00000100:00100000:1.0:1788448278.206818:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448278.206824:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826226560:12345-0@lo:400: 00000100:00100000:1.0:1788448278.206875:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826226560:12345-0@lo:400: Request processed in 50us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448278.206907:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788448278.207024:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826226560:0@lo:400: 00010000:00010000:1.0:1788448278.526007:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448279.551428:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448280.574411:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788448281.253634:0:8425:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788448281.253639:0:8425:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788448281.253642:0:8425:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788448281.254094:0:8425:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc1ba23b000 00000020:01000004:1.0:1788448281.254115:0:8425:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788448281.254132:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788448281.254164:0:8425:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fc1bb79cd28) 00000020:00000080:1.0:1788448281.254197:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00000100:00100000:1.0:1788448281.280554:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826226944:0@lo:41: 00000100:00100000:1.0:1788448281.280649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.280759:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826226944 00000100:00100000:0.0:1788448281.280775:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826226944 00000100:00100000:0.0:1788448281.281221:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448281.281360:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826226944:12345-0@lo:41: 00000004:00000024:0.0:1788448281.281415:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788448281.282351:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826226944:12345-0@lo:41: Request processed in 1114us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448281.282361:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448281.282495:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826226944:0@lo:41: 00100000:10000000:3.0:1788448281.320102:0:8425:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788448281.320202:0:8425:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788448281.366381:0:8425:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788448281.367232:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788448281.367247:0:8425:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788448281.368196:0:8425:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45a9e4e6b803453 00000020:01000004:3.0:1788448281.368211:0:8425:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788448281.370140:0:8425:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788448281.370178:0:8425:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788448281.370189:0:8425:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788448281.370199:0:8425:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788448281.370234:0:8425:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fc1b5d599b8) 00000020:00000080:2.0:1788448281.370269:0:8425:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788448281.371876:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448281.372120:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788448281.372128:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788448281.382812:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788448281.382831:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788448281.383617:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788448281.383628:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788448281.387271:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448281.387576:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788448281.387582:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788448281.390873:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788448281.390975:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788448281.436318:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448281.436629:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788448281.436637:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788448281.439613:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788448281.439634:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788448281.441456:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788448281.441472:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788448281.444547:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448281.444796:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788448281.444803:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788448281.446619:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788448281.446635:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788448281.496826:0:8425:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448281.497326:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788448281.497334:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788448281.505583:0:8425:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788448281.505603:0:8425:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788448281.506712:0:8425:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788448281.506752:0:8425:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788448281.506760:0:8425:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788448281.576036:0:8425:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788448281.576093:0:8425:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788448281.576098:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788448281.576100:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788448281.576101:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448281.576103:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448281.576104:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448281.576105:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448281.576107:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448281.576109:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448281.576110:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448281.576112:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448281.576118:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448281.576123:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788448281.576125:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448281.576127:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788448281.576128:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448281.576129:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448281.576130:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448281.576130:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448281.576131:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448281.576132:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448281.576133:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448281.576134:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448281.576135:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448281.576181:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788448281.576204:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826227072:0@lo:253: 00000100:00100000:3.0:1788448281.576322:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.576391:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19284bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448281.576672:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227072 00000100:00100000:0.0:1788448281.576682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227072 00000100:00100000:0.0:1788448281.576747:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788448281.576758:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8425:x1875323826227072:12345-0@lo:253: 20000000:01000000:0.0:1788448281.577487:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788448281.577495:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788448281.577502:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788448281.577506:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788448281.577862:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448281.578064:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788448281.578081:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788448281.578099:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788448281.578122:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788448281.578139:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788448281.578156:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788448281.578447:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788448281.578469:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1788448281.578471:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448281.578487:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788448281.578494:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448281.578509:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788448281.578515:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448281.578530:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788448281.578538:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788448281.578568:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788448281.578587:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788448281.578672:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788448281.578684:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1788448281.578685:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448281.578700:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788448281.578705:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448281.578720:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788448281.578726:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448281.578739:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788448281.578744:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788448281.578757:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788448281.578774:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788448281.579321:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788448281.579335:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1788448281.579337:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448281.579352:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788448281.579358:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788448281.579369:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788448281.579389:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448281.579406:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788448281.579412:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788448281.579425:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788448281.579440:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788448281.579455:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788448281.579458:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788448281.579462:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788448281.579530:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788448281.579533:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788448281.582546:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:0.0:1788448281.582735:0:8444:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:0.0:1788448281.582755:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788448281.583305:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788448281.583334:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788448281.583349:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1788448281.583361:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788448281.583364:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788448281.584297:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788448281.584370:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788448281.584390:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788448281.584671:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788448281.584693:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788448281.584706:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1788448281.584718:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788448281.584720:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788448281.585464:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:2.0:1788448281.585502:0:8446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:2.0:1788448281.585518:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788448281.586264:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1788448281.586320:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1788448281.586339:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1788448281.586357:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788448281.586359:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788448281.587541:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788448281.587783:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788448281.587830:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788448281.587848:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1788448281.587867:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788448281.587931:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.587953:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.587962:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.587969:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.587977:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.587984:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.587993:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.588237:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.588260:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 18 pid: 6511 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.588278:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227200:0@lo:104: 00000100:00100000:1.0:1788448281.588363:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448281.588446:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.588456:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 18 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.588466:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227328:0@lo:104: 00000100:00100000:1.0:1788448281.588490:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448281.588518:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.588527:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 18 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.588536:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227456:0@lo:104: 00000100:00100000:1.0:1788448281.588558:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448281.588576:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.588584:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 18 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.588593:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227584:0@lo:104: 00000100:00100000:1.0:1788448281.588614:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448281.588631:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.588640:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 18 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.588649:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227712:0@lo:104: 00000100:00100000:1.0:1788448281.588680:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448281.588692:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448281.590102:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227200 00000100:00100000:2.0:1788448281.590129:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227200 00000100:00100000:2.0:1788448281.590200:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227328 00000100:00100000:2.0:1788448281.590205:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227328 00000100:00100000:2.0:1788448281.590250:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227456 00000100:00100000:2.0:1788448281.590254:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227456 00000100:00100000:2.0:1788448281.590265:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227584 00000100:00100000:2.0:1788448281.590268:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227584 00000100:00100000:2.0:1788448281.590278:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227712 00000100:00100000:2.0:1788448281.590281:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227712 00000100:00100000:2.0:1788448281.590298:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448281.590310:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+7:6510:x1875323826227200:12345-0@lo:104: 00010000:00010000:2.0:1788448281.590329:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590435:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448281.590442:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+7:6510:x1875323826227200:12345-0@lo:104: Request processed in 134us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.590449:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448281.590469:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448281.590476:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6510:x1875323826227328:12345-0@lo:104: 00010000:00010000:2.0:1788448281.590484:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590522:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448281.590528:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6510:x1875323826227328:12345-0@lo:104: Request processed in 53us (2037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.590534:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448281.590546:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448281.590553:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6510:x1875323826227456:12345-0@lo:104: 00010000:00010000:2.0:1788448281.590561:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590602:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788448281.590607:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6510:x1875323826227456:12345-0@lo:104: Request processed in 55us (2048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.590614:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448281.590626:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448281.590633:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6510:x1875323826227584:12345-0@lo:104: 00010000:00010000:2.0:1788448281.590641:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590667:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788448281.590672:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6510:x1875323826227584:12345-0@lo:104: Request processed in 40us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.590677:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448281.590687:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448281.590693:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6510:x1875323826227712:12345-0@lo:104: 00010000:00010000:2.0:1788448281.590700:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590724:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788448281.590729:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6510:x1875323826227712:12345-0@lo:104: Request processed in 37us (2050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.590734:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788448281.590755:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788448281.590762:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590769:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.590779:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590789:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.590797:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.590804:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.590848:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590855:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.590875:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590908:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b80341b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803422 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590940:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448281.590943:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590949:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ae00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.590952:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.590959:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.590976:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.590981:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.590996:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591002:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.591019:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591025:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ae00/0xf45a9e4e6b8033f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033f8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591034:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448281.591037:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591043:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.591045:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591051:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.591058:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.591063:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.591082:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591088:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.591094:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591100:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b8033d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033dc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591110:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448281.591113:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591118:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.591120:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591127:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.591133:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.591138:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.591148:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591153:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.591158:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591185:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b80339d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033a4 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591196:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448281.591199:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591204:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204be00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.591207:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591214:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.591220:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.591225:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.591238:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591243:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.591247:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591252:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204be00/0xf45a9e4e6b803326 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80332d expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591266:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448281.591273:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448281.591275:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448281.591283:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448281.591311:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826227840:0@lo:103: 00000100:00100000:2.0:1788448281.591359:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.591400:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826228352:0@lo:103: 00000100:00100000:2.0:1788448281.591420:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.591444:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448281.591449:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826228224:0@lo:103: 00000100:00100000:2.0:1788448281.591470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.591500:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826227968:0@lo:103: 00000100:00100000:2.0:1788448281.591523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.591536:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448281.591541:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826228096:0@lo:103: 00000100:00100000:2.0:1788448281.591565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.591589:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227840 00000100:00100000:2.0:1788448281.591594:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227840 00010000:00010000:2.0:1788448281.591619:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 19 pid: 6511 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.591634:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228352 00000100:00100000:2.0:1788448281.591637:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228352 00010000:00010000:2.0:1788448281.591646:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 20 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.591655:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228224 00000100:00100000:2.0:1788448281.591657:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228224 00010000:00010000:2.0:1788448281.591666:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 21 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.591688:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826227968 00000100:00100000:2.0:1788448281.591691:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826227968 00010000:00010000:2.0:1788448281.591703:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 22 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.591713:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228096 00000100:00100000:2.0:1788448281.591715:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228096 00010000:00010000:2.0:1788448281.591724:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 23 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.591736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448281.591743:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3646:x1875323826227840:12345-0@lo:103: 00010000:00010000:2.0:1788448281.591771:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.591778:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 23 pid: 6511 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591789:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 23 pid: 6511 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591809:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.591841:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3646:x1875323826227840:12345-0@lo:103: Request processed in 99us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.591848:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448281.591863:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448281.591869:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3646:x1875323826228352:12345-0@lo:103: 00010000:00010000:2.0:1788448281.591877:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.591915:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 22 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591934:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 22 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.591943:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.591966:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3646:x1875323826228352:12345-0@lo:103: Request processed in 97us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.591972:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448281.591983:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448281.591989:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3646:x1875323826228224:12345-0@lo:103: 00010000:00010000:2.0:1788448281.591997:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.592001:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 21 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592008:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 21 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592017:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.592035:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3646:x1875323826228224:12345-0@lo:103: Request processed in 47us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.592041:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448281.592056:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448281.592062:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3647:x1875323826227968:12345-0@lo:103: 00010000:00010000:2.0:1788448281.592069:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.592073:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 20 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592081:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 20 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592097:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.592124:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3647:x1875323826227968:12345-0@lo:103: Request processed in 62us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.592130:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448281.592141:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448281.592147:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3647:x1875323826228096:12345-0@lo:103: 00010000:00010000:2.0:1788448281.592153:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.592157:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 19 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592180:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 19 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592194:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592202:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592218:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592225:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592232:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592238:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592250:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448281.592255:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592263:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592271:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.592281:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.592304:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3647:x1875323826228096:12345-0@lo:103: Request processed in 157us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.592310:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448281.592391:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826228096:0@lo:103: 00000100:00100000:2.0:1788448281.592400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826227968:0@lo:103: 00000100:00100000:2.0:1788448281.592424:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826228224:0@lo:103: 00000100:00100000:2.0:1788448281.592431:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826227840:0@lo:103: 00000100:00100000:2.0:1788448281.592437:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826228352:0@lo:103: 00010000:00010000:1.0:1788448281.593823:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b803422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80341b expref: 18 pid: 6511 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.593849:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227200:0@lo:104: 00010000:00010000:1.0:1788448281.593863:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b8033f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8033f1 expref: 17 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.593875:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227328:0@lo:104: 00010000:00010000:1.0:1788448281.593903:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b8033dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8033d5 expref: 16 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.593932:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6ad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227456:0@lo:104: 00010000:00010000:1.0:1788448281.593945:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181680200/0xf45a9e4e6b8033a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80339d expref: 15 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.593960:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227584:0@lo:104: 00010000:00010000:1.0:1788448281.593971:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f200/0xf45a9e4e6b80332d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803326 expref: 14 pid: 6509 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.593982:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6510:1875323826227712:0@lo:104: 00010000:00010000:1.0:1788448281.594024:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.594036:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.594055:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.594077:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803461 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448281.594095:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788448281.599313:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448281.600428:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:8425:x1875323826227072:12345-0@lo:253: Request processed in 23662us (24097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.600443:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788448281.600577:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826227072:0@lo:253: 10000000:01000000:3.0:1788448281.600599:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788448281.600603:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788448281.600605:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788448281.600607:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448281.600608:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788448281.600610:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448281.600611:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448281.600613:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448281.600615:0:8425:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788448281.600617:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448281.600619:0:8425:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788448281.600642:0:8425:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc1ba23b000 from lustre-OST0000 10000000:01000000:3.0:1788448281.600698:0:8425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788448281.600701:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788448281.600711:0:8425:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc19ebe99b8 local copy 10000000:01000000:3.0:1788448281.600715:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788448281.600757:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.600778:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.600790:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448281.600811:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228480:0@lo:101: 00000100:00100000:3.0:1788448281.600853:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.601184:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228480 00000100:00100000:2.0:1788448281.601193:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228480 00000100:00100000:2.0:1788448281.601250:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788448281.601263:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+13:8425:x1875323826228480:12345-0@lo:101: 00010000:00010000:2.0:1788448281.601279:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448281.601305:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80346f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803468 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.601336:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80346f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803468 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.601348:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80346f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803468 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.601359:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681a00, rc 0) 00000100:00100000:2.0:1788448281.601395:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:8425:x1875323826228480:12345-0@lo:101: Request processed in 135us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.601401:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788448281.601492:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448281.601509:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228480:0@lo:101: 00010000:00010000:3.0:1788448281.601523:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.601532:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448281.601689:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228608:0@lo:501: 00000100:00100000:3.0:1788448281.601717:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.601771:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.602291:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228608 00000100:00100000:1.0:1788448281.602299:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228608 00000100:00100000:1.0:1788448281.602376:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788448281.602386:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:8425:x1875323826228608:12345-0@lo:501: 00000100:00100000:1.0:1788448281.602478:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:8425:x1875323826228608:12345-0@lo:501: Request processed in 93us (760us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448281.602485:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788448281.602554:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228608:0@lo:501: 10000000:01000000:3.0:1788448281.602582:0:8425:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788448281.602604:0:8425:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788448281.602611:0:8425:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.602620:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.602639:0:8425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.602669:0:8425:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788448281.602699:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc1ba23b000 10000000:01000000:3.0:1788448281.602704:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788448281.602710:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788448281.602712:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448281.602716:0:8425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788448281.602719:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788448281.602743:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.602751:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.602759:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448281.602772:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228736:0@lo:101: 00000100:00100000:3.0:1788448281.602802:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448281.602837:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448281.602846:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.602854:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448281.602857:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.602865:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448281.602872:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448281.602878:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448281.602928:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.602935:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448281.602963:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.602970:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803468 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b80346f expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.602984:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448281.602986:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448281.602987:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448281.603699:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228736 00000100:00100000:2.0:1788448281.603708:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228736 00000100:00100000:2.0:1788448281.603746:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788448281.603756:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:8425:x1875323826228736:12345-0@lo:101: 00010000:00010000:2.0:1788448281.603769:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448281.603785:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803476 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.603810:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.603821:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.603830:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681600, rc 0) 00000100:00100000:2.0:1788448281.603870:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826228736:12345-0@lo:101: Request processed in 116us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.603908:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788448281.603959:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448281.603975:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826228864:0@lo:103: 00000100:00100000:2.0:1788448281.604008:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.604242:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448281.604266:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228736:0@lo:101: 00010000:00010000:3.0:1788448281.604284:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.604295:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448281.604413:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228992:0@lo:501: 00000100:00100000:3.0:1788448281.604462:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.604495:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.604553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228992 00000100:00100000:1.0:1788448281.604559:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228992 00000100:00100000:1.0:1788448281.604609:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788448281.604617:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826228992:12345-0@lo:501: 00000100:00100000:1.0:1788448281.604731:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826228992:12345-0@lo:501: Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.604739:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788448281.604856:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826228992:0@lo:501: 00000100:00100000:3.0:1788448281.604927:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229120:0@lo:503: 00000100:00100000:3.0:1788448281.604970:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.604987:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.605126:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229120 00000100:00100000:1.0:1788448281.605131:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229120 00000100:00100000:1.0:1788448281.605154:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788448281.605161:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229120:12345-0@lo:503: 00000100:00100000:1.0:1788448281.605251:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229120:12345-0@lo:503: Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.605264:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788448281.605410:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229120:0@lo:503: 00000040:00080000:3.0:1788448281.605720:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448281.605796:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229248:0@lo:502: 00000100:00100000:3.0:1788448281.605854:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.605877:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.606513:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229248 00000100:00100000:1.0:1788448281.606520:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229248 00000100:00100000:1.0:1788448281.606559:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788448281.606579:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229248:12345-0@lo:502: 00000100:00100000:1.0:1788448281.606693:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229248:12345-0@lo:502: Request processed in 125us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.606700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788448281.606853:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229248:0@lo:502: 00000040:00080000:3.0:1788448281.607246:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788448281.607277:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788448281.607292:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788448281.607305:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788448281.607318:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788448281.607331:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788448281.607365:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229376:0@lo:502: 00000100:00100000:3.0:1788448281.607412:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.607442:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.607509:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229376 00000100:00100000:1.0:1788448281.607515:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229376 00000100:00100000:1.0:1788448281.607547:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788448281.607554:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229376:12345-0@lo:502: 00000100:00100000:1.0:1788448281.607682:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229376:12345-0@lo:502: Request processed in 128us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.607689:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788448281.607772:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229376:0@lo:502: 00000040:00080000:3.0:1788448281.607807:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788448281.607819:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788448281.608811:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448281.608823:0:8448:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788448281.608830:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448281.608832:0:8448:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788448281.608837:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448281.608855:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fc1bb798000) 00000020:00000080:1.0:1788448281.608919:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788448281.608928:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788448281.609018:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1ba23b000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788448281.609028:0:8448:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788448281.609036:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45a9e4e6b80348b 00000100:00100000:0.0:1788448281.616978:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826228864 00000100:00100000:0.0:1788448281.616999:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826228864 00000100:00100000:0.0:1788448281.617090:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448281.617113:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3648:x1875323826228864:12345-0@lo:103: 00010000:00010000:0.0:1788448281.617134:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448281.617162:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80346f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803468 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.617196:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448281.617300:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:3648:x1875323826228864:12345-0@lo:103: Request processed in 199us (13289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448281.617308:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448281.617587:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826228864:0@lo:103: 00010000:00010000:1.0:1788448281.620695:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788448281.624056:0:8448:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788448281.628658:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788448281.629375:0:8448:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1788448281.634280:0:8448:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788448281.634702:0:8448:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788448281.641131:0:8448:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:1.0:1788448281.644231:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788448281.644248:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448281.644258:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448281.644260:0:8448:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788448281.644264:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448281.644269:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448281.644270:0:8448:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448281.644274:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448281.644277:0:8448:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448281.644311:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448281.644314:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448281.644315:0:8448:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788448281.644319:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788448281.648734:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788448281.648792:0:8425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788448281.648822:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.648838:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448281.648847:0:8425:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1ba23b000 from 1 10000000:01000000:0.0:1788448281.648864:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448281.649034:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.649044:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.649057:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448281.649087:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229504:0@lo:101: 00000100:00100000:0.0:1788448281.649183:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.649281:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.653728:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229504 00000100:00100000:1.0:1788448281.653746:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229504 00000100:00100000:1.0:1788448281.653859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448281.653873:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:8425:x1875323826229504:12345-0@lo:101: 00010000:00010000:1.0:1788448281.653931:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448281.653960:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803492 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.653999:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.654012:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.654050:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8a00, rc 0) 00000100:00100000:1.0:1788448281.654151:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229504:12345-0@lo:101: Request processed in 281us (4968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.654158:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788448281.654285:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229504:0@lo:101: 00010000:00010000:0.0:1788448281.654309:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.654321:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448281.654465:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229632:0@lo:501: 00000100:00100000:0.0:1788448281.654510:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.655747:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448281.656108:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229632 00000100:00100000:3.0:1788448281.656119:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229632 00000100:00100000:3.0:1788448281.656183:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788448281.656195:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229632:12345-0@lo:501: 00000100:00100000:3.0:1788448281.656424:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229632:12345-0@lo:501: Request processed in 230us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448281.656446:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788448281.657509:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229632:0@lo:501: 00000100:00100000:0.0:1788448281.657635:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229760:0@lo:503: 00000100:00100000:0.0:1788448281.657723:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.657806:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448281.657852:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229760 00000100:00100000:3.0:1788448281.657861:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229760 00000100:00100000:3.0:1788448281.658160:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788448281.658181:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229760:12345-0@lo:503: 00000100:00100000:3.0:1788448281.658321:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229760:12345-0@lo:503: Request processed in 142us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448281.658330:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788448281.658412:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229760:0@lo:503: 00000040:00080000:0.0:1788448281.658757:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448281.658856:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229888:0@lo:502: 00000100:00100000:0.0:1788448281.659010:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.659207:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.659248:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826229888 00000100:00100000:1.0:1788448281.659255:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826229888 00000100:00100000:1.0:1788448281.659290:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788448281.659300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229888:12345-0@lo:502: 00000100:00100000:1.0:1788448281.659455:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826229888:12345-0@lo:502: Request processed in 155us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.659462:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788448281.659845:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826229888:0@lo:502: 00000040:00080000:0.0:1788448281.660822:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788448281.660859:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788448281.661083:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230016:0@lo:502: 00000100:00100000:0.0:1788448281.661174:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.661265:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.661315:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230016 00000100:00100000:1.0:1788448281.661323:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230016 00000100:00100000:1.0:1788448281.661414:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788448281.661425:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826230016:12345-0@lo:502: 00000100:00100000:1.0:1788448281.661556:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826230016:12345-0@lo:502: Request processed in 133us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.661564:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788448281.662254:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230016:0@lo:502: 00000040:00080000:0.0:1788448281.662335:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788448281.662348:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788448281.666260:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448281.666280:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448281.666283:0:8452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788448281.666292:0:8452:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1ba23b000 00000020:00000080:3.0:1788448281.666295:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448281.666310:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448281.666314:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448281.666315:0:8452:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788448281.666319:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788448281.666540:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788448281.666572:0:8425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448281.666604:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.666619:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448281.666674:0:8425:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788448281.666678:0:8425:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc1ba23b000 10000000:01000000:0.0:1788448281.666681:0:8425:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc1ba23b000 10000000:01000000:0.0:1788448281.666686:0:8425:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448281.666693:0:8425:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1ba23b000 from 1 10000000:01000000:0.0:1788448281.666696:0:8425:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448281.666743:0:8425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.666769:0:8425:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448281.666783:0:8425:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448281.666813:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230144:0@lo:101: 00000100:00100000:0.0:1788448281.667024:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.667082:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448281.667231:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230144 00000100:00100000:2.0:1788448281.667241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230144 00000100:00100000:2.0:1788448281.667301:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448281.667312:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8425:x1875323826230144:12345-0@lo:101: 00010000:00010000:2.0:1788448281.667327:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448281.667343:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8034a0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.667371:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.667383:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.667393:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681400, rc 0) 00000100:00100000:2.0:1788448281.667449:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230144:12345-0@lo:101: Request processed in 139us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.667455:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788448281.667518:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230144:0@lo:101: 00010000:00010000:3.0:1788448281.667535:0:8425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.667545:0:8425:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448281.667671:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230272:0@lo:501: 00000100:00100000:3.0:1788448281.667703:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.667730:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448281.667779:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230272 00000100:00100000:0.0:1788448281.667784:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230272 00000100:00100000:0.0:1788448281.667805:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788448281.667811:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230272:12345-0@lo:501: 00000100:00100000:0.0:1788448281.668041:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230272:12345-0@lo:501: Request processed in 229us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448281.668048:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788448281.668129:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230272:0@lo:501: 00000100:00100000:3.0:1788448281.668158:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230400:0@lo:503: 00000100:00100000:3.0:1788448281.668211:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.668243:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448281.668421:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230400 00000100:00100000:2.0:1788448281.668426:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230400 00000100:00100000:2.0:1788448281.668460:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788448281.668467:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230400:12345-0@lo:503: 00000100:00100000:2.0:1788448281.668558:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230400:12345-0@lo:503: Request processed in 92us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.668565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788448281.668618:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230400:0@lo:503: 00000040:00080000:2.0:1788448281.668992:0:8425:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448281.669221:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230528:0@lo:502: 00000100:00100000:2.0:1788448281.669272:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.669398:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18529eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448281.669439:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230528 00000100:00100000:1.0:1788448281.669446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230528 00000100:00100000:1.0:1788448281.669518:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788448281.669528:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230528:12345-0@lo:502: 00000100:00100000:1.0:1788448281.669638:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230528:12345-0@lo:502: Request processed in 111us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.669645:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788448281.669718:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230528:0@lo:502: 00000040:00080000:3.0:1788448281.670088:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788448281.670118:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788448281.670133:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788448281.670146:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788448281.670158:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788448281.670257:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788448281.670272:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788448281.670286:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788448281.670298:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788448281.670310:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788448281.670323:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788448281.670335:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788448281.670347:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788448281.670359:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788448281.670371:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788448281.670386:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788448281.670415:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788448281.670431:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788448281.670444:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788448281.670469:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788448281.670483:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788448281.670497:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788448281.670510:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788448281.670525:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788448281.670540:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788448281.670554:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788448281.670566:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788448281.670579:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788448281.670591:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788448281.670603:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788448281.670614:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788448281.670626:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788448281.670648:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788448281.670661:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788448281.670673:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788448281.670684:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788448281.670696:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788448281.670729:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230656:0@lo:502: 00000100:00100000:3.0:1788448281.670786:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.670832:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448281.671157:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230656 00000100:00100000:0.0:1788448281.671173:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230656 00000100:00100000:0.0:1788448281.671263:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788448281.671274:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230656:12345-0@lo:502: 00000100:00100000:0.0:1788448281.671409:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826230656:12345-0@lo:502: Request processed in 136us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448281.671417:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788448281.671497:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826230656:0@lo:502: 00000040:00080000:3.0:1788448281.671548:0:8425:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788448281.671558:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788448281.672491:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788448281.672510:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fc1b5d5cd28) 00000020:00000080:2.0:1788448281.672537:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:2.0:1788448281.672642:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1ba23b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788448281.672646:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1ba23b000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788448281.672649:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1ba23b000 3 00010000:00080000:2.0:1788448281.672794:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1b59e9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448281.676520:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:0.0:1788448281.676812:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788448281.676865:0:8453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448281.680047:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf45a9e4e6b8034b5 00000100:00080000:0.0:1788448281.680069:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448281.680077:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc1b59e9000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448281.680125:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1c11cdc00 x1875323826230784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448281.680156:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788448281.680439:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826231296:0@lo:400: 00000100:00100000:2.0:1788448281.680524:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.680571:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448281.680577:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826230912:0@lo:400: 00000100:00100000:2.0:1788448281.680602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.680631:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826231040:0@lo:400: 00000100:00100000:2.0:1788448281.680655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.680672:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448281.680677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826231168:0@lo:400: 00000100:00100000:2.0:1788448281.680696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.680727:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231296 00000100:00100000:2.0:1788448281.680745:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231296 00000100:00100000:2.0:1788448281.680782:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231040 00000100:00100000:2.0:1788448281.680784:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231040 00000100:00100000:2.0:1788448281.680799:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448281.680808:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826231296:12345-0@lo:400: 00000100:00100000:2.0:1788448281.680870:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826231296:12345-0@lo:400: Request processed in 62us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.680996:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448281.681017:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448281.681024:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826231040:12345-0@lo:400: 00000100:00100000:2.0:1788448281.681129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826231040:12345-0@lo:400: Request processed in 106us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.681136:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448281.681190:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826231040:0@lo:400: 00000100:00100000:2.0:1788448281.681222:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826231296:0@lo:400: 00000100:00100000:1.0:1788448281.681453:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826230784:0@lo:38: 00000100:00100000:1.0:1788448281.681501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448281.681559:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230912 00000100:00100000:1.0:1788448281.681564:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230912 00000100:00100000:1.0:1788448281.681588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231168 00000100:00100000:1.0:1788448281.681590:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231168 00000100:00100000:1.0:1788448281.681599:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826230784 00000100:00100000:1.0:1788448281.681601:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826230784 00000100:00100000:1.0:1788448281.681612:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788448281.681618:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826230912:12345-0@lo:400: 00000100:00100000:1.0:1788448281.681662:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826230912:12345-0@lo:400: Request processed in 44us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.681669:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788448281.681681:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448281.681687:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826231168:12345-0@lo:400: 00000100:00100000:1.0:1788448281.681715:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826231168:12345-0@lo:400: Request processed in 29us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.681721:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448281.681731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448281.681735:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826230784:12345-0@lo:38: 00010000:00080000:1.0:1788448281.681758:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788448281.681795:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf45a9e4e6b8034bc 00000004:00100000:1.0:1788448281.681811:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788448281.681845:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448281.681907:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875323826230784:12345-0@lo:38: Request processed in 170us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.682113:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788448281.682156:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1c11cdc00 x1875323826230784/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448281.682185:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448281.682194:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788448281.682204:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788448281.682209:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788448281.682212:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788448281.682218:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826230784:0@lo:38: 00010000:00080000:1.0:1788448281.682252:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1ba1f2d80 x1875323826231168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448281.682260:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826231168:0@lo:400: 00010000:00080000:2.0:1788448281.683343:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc1ba1f0a80 x1875323826230912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448297 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448281.683357:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826230912:0@lo:400: 00000020:01000004:1.0:1788448281.683652:0:8453:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788448281.683671:0:8453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fc1bb79b370) 00000020:00000080:1.0:1788448281.683696:0:8453:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788448281.683815:0:8453:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1ba23b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788448281.683820:0:8453:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1ba23b000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788448281.683823:0:8453:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1ba23b000 3 00010000:00080000:1.0:1788448281.683856:0:8453:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc081ac1000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448281.689420:0:8453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788448281.689650:0:8453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788448281.689699:0:8453:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788448281.689714:0:8453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf45a9e4e6b8034ca 00000100:00080000:1.0:1788448281.689727:0:8453:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448281.689733:0:8453:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fc081ac1000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448281.689775:0:8453:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc081a6b100 x1875323826231424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448281.689822:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826231424:0@lo:38: 00000100:00080000:0.0:1788448281.692057:0:8453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788448281.692256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.692498:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231424 00000100:00100000:0.0:1788448281.692509:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231424 00000100:00100000:0.0:1788448281.692556:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448281.692566:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826231424:12345-0@lo:38: 00010000:00080000:0.0:1788448281.692601:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:0.0:1788448281.692641:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf45a9e4e6b8034d1 00000004:00100000:0.0:1788448281.692658:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788448281.692693:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9fc1b738b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448281.692772:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875323826231424:12345-0@lo:38: Request processed in 206us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448281.692780:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788448281.694469:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc081a6b100 x1875323826231424/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448281.694485:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448281.694495:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788448281.694504:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788448281.694510:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788448281.694514:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac1000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788448281.694521:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826231424:0@lo:38: 00000040:00080000:2.0:1788448281.699209:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788448281.699289:0:8425:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788448281.699323:0:8425:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448281.699350:0:8425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448281.699364:0:8425:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788448281.699434:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788448281.699437:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788448281.699438:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448281.699439:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448281.699440:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448281.699441:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448281.699443:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448281.699444:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448281.699446:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448281.699447:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448281.699449:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448281.699453:0:8425:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788448281.699456:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448281.699457:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788448281.699458:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448281.699459:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448281.699460:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448281.699462:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448281.699463:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448281.699464:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448281.699465:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448281.699466:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448281.699467:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788448281.699497:0:8425:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788448281.699519:0:8425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826231552:0@lo:253: 00000100:00100000:3.0:1788448281.699599:0:8425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448281.699684:0:8425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448281.699725:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231552 00000100:00100000:0.0:1788448281.699733:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231552 00000100:00100000:0.0:1788448281.699788:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788448281.699798:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826231552:12345-0@lo:253: 20000000:01000000:0.0:1788448281.699828:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448281.700181:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448281.706920:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448281.706939:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788448281.706946:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788448281.706952:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788448281.706981:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.707004:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.707013:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.707021:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.707079:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.707096:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 16 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.707130:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826231680:0@lo:104: 00000100:00100000:1.0:1788448281.707233:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448281.707288:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448281.707297:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 16 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448281.707305:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826231808:0@lo:104: 00000100:00100000:0.0:1788448281.707324:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:8425:x1875323826231552:12345-0@lo:253: Request processed in 7526us (7723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448281.707325:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196b3e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448281.707345:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788448281.707412:0:8425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8425:1875323826231552:0@lo:253: 10000000:01000000:3.0:1788448281.707427:0:8425:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788448281.707431:0:8425:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788448281.707433:0:8425:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788448281.707435:0:8425:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448281.707436:0:8425:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448281.707437:0:8425:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448281.707438:0:8425:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448281.707446:0:8425:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448281.707448:0:8425:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448281.707449:0:8425:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448281.707451:0:8425:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448281.707452:0:8425:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788448281.707468:0:8425:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788448281.707523:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788448281.707543:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448281.707573:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231680 00000100:00100000:2.0:1788448281.707580:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231680 00000100:00100000:2.0:1788448281.707616:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231808 00000100:00100000:2.0:1788448281.707619:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231808 00000100:00100000:2.0:1788448281.707633:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448281.707643:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba276050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826231680:12345-0@lo:104: 00010000:00010000:2.0:1788448281.707664:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.707728:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448281.707734:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba276050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826231680:12345-0@lo:104: Request processed in 94us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.707741:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448281.707787:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448281.707793:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826231808:12345-0@lo:104: 00010000:00010000:2.0:1788448281.707801:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.707842:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448281.707848:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826231808:12345-0@lo:104: Request processed in 55us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.707853:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788448281.707871:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448281.707877:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.707906:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.708023:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708035:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.708053:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.708066:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.708100:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708188:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.708212:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708220:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b8033e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033ea expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708233:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448281.708237:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708242:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448281.708245:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708252:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448281.708258:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448281.708264:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448281.708278:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708284:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448281.708306:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708312:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204a600/0xf45a9e4e6b8033c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8033ce expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.708327:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448281.708329:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448281.708331:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448281.708339:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448281.708353:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826231936:0@lo:103: 00000100:00100000:1.0:1788448281.708450:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826232064:0@lo:103: 00000100:00100000:0.0:1788448281.708572:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826231680:0@lo:104: 00000100:00100000:0.0:1788448281.708583:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826231808:0@lo:104: 00010000:00010000:0.0:1788448281.708603:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.710770:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448281.711434:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448281.711573:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826231936 00000100:00100000:0.0:1788448281.711584:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826231936 00010000:00010000:0.0:1788448281.711629:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 16 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448281.711703:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232064 00000100:00100000:0.0:1788448281.711707:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232064 00010000:00010000:0.0:1788448281.711721:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 17 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.711755:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448281.711769:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:3648:x1875323826231936:12345-0@lo:103: 00010000:00010000:2.0:1788448281.711799:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.711807:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.711822:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.711852:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b8033ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8033e3 expref: 17 pid: 6510 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.711869:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.711958:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3648:x1875323826231936:12345-0@lo:103: Request processed in 193us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.711966:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448281.711988:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448281.711994:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3645:x1875323826232064:12345-0@lo:103: 00010000:00010000:2.0:1788448281.712020:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448281.712024:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 15 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712035:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 15 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712057:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8033ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8033c7 expref: 15 pid: 6511 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712068:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712076:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788448281.712094:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009023884s 00010000:00010000:2.0:1788448281.712099:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712305:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712313:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712320:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712326:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448281.712331:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712347:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712367:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.712379:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448281.712415:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:3645:x1875323826232064:12345-0@lo:103: Request processed in 420us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448281.712422:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448281.712528:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826232064:0@lo:103: 00010000:00010000:2.0:1788448281.713023:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.713035:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448281.713052:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8034d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448281.713092:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826231936:0@lo:103: 00080000:10000000:3.0:1788448281.719746:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788448281.720641:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788448281.722485:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788448281.722850:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788448281.726570:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788448281.726868:0:8425:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788448281.731513:0:8425:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788448281.752266:0:8425:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788448281.752275:0:8425:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788448281.752335:0:8425:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788448281.752553:0:8425:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788448281.752578:0:8425:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788448281.752596:0:8425:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788448281.759080:0:8425:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448281.759290:0:8425:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788448282.625341:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788448282.698329:0:8509:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448282.698537:0:8509:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1788448283.006000:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788448283.006009:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc19ea22000 from 30 10000000:01000000:0.0:1788448283.006014:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448283.006063:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.006075:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.006086:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.006110:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232192:0@lo:101: 00000100:00100000:0.0:1788448283.006204:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.006346:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.009713:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232192 00000100:00100000:3.0:1788448283.009728:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232192 00000100:00100000:2.0:1788448283.009858:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788448283.009869:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:6514:x1875323826232192:12345-0@lo:101: 00010000:00010000:2.0:1788448283.009913:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448283.009932:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8034df expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448283.009975:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448283.009988:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448283.009998:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181680000, rc 0) 00000100:00100000:2.0:1788448283.010067:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826232192:12345-0@lo:101: Request processed in 201us (3864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.010074:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788448283.010325:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232192:0@lo:101: 00010000:00010000:0.0:1788448283.010343:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.010353:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.010427:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232320:0@lo:501: 00000100:00100000:0.0:1788448283.010462:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.010600:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d193c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.015234:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232320 00000100:00100000:3.0:1788448283.015250:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232320 00000100:00100000:0.0:1788448283.016376:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448283.016388:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826232320:12345-0@lo:501: 00000100:00100000:0.0:1788448283.016570:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826232320:12345-0@lo:501: Request processed in 182us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.016578:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788448283.016615:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232320:0@lo:501: 00000100:00100000:2.0:1788448283.016665:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232448:0@lo:503: 00000100:00100000:2.0:1788448283.023055:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.023104:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.023774:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232448 00000100:00100000:0.0:1788448283.023784:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232448 00000100:00100000:0.0:1788448283.023849:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448283.023858:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826232448:12345-0@lo:503: 00000100:00100000:0.0:1788448283.024002:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826232448:12345-0@lo:503: Request processed in 144us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.024009:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788448283.024202:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232448:0@lo:503: 00000100:00100000:2.0:1788448283.025734:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8528:1875323826232576:0@lo:502: 00000100:00100000:2.0:1788448283.025955:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.025993:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.026147:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232576 00000100:00100000:0.0:1788448283.026153:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232576 00000100:00100000:0.0:1788448283.026200:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448283.026214:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8528:x1875323826232576:12345-0@lo:502: 00000100:00100000:0.0:1788448283.026446:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8528:x1875323826232576:12345-0@lo:502: Request processed in 232us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.026454:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788448283.026547:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8528:1875323826232576:0@lo:502: 00000100:00100000:2.0:1788448283.026609:0:8528:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8528:1875323826232704:0@lo:502: 00000100:00100000:2.0:1788448283.027231:0:8528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.027259:0:8528:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.027454:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232704 00000100:00100000:0.0:1788448283.027460:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232704 00000100:00100000:0.0:1788448283.027489:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788448283.027496:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8528:x1875323826232704:12345-0@lo:502: 00000100:00100000:0.0:1788448283.027578:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:8528:x1875323826232704:12345-0@lo:502: Request processed in 82us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.027585:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448283.027875:0:8528:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8528:1875323826232704:0@lo:502: 00000040:00080000:2.0:1788448283.027925:0:8528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788448283.028151:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788448283.028181:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448283.028191:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.028201:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448283.028210:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448283.028213:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc19ea22000 from 5 10000000:01000000:0.0:1788448283.028216:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448283.028242:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.028250:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.028259:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.028693:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232832:0@lo:101: 00000100:00100000:0.0:1788448283.028735:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.028766:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448283.028920:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232832 00000100:00100000:2.0:1788448283.028926:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232832 00000100:00100000:2.0:1788448283.028958:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448283.028965:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826232832:12345-0@lo:101: 00010000:00010000:2.0:1788448283.028975:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448283.028988:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8034ed expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448283.029008:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448283.029017:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448283.029026:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681800, rc 0) 00000100:00100000:2.0:1788448283.029066:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826232832:12345-0@lo:101: Request processed in 101us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.029071:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788448283.029412:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232832:0@lo:101: 00010000:00010000:3.0:1788448283.029425:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.029434:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448283.029487:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232960:0@lo:256: 00000100:00100000:3.0:1788448283.029518:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.029542:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448283.029718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826232960 00000100:00100000:2.0:1788448283.029722:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826232960 00000100:00100000:2.0:1788448283.029753:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788448283.029759:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826232960:12345-0@lo:256: 20000000:01000000:2.0:1788448283.029775:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448283.030391:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448283.030395:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788448283.030500:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826232960:12345-0@lo:256: Request processed in 739us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.030507:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788448283.030914:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826232960:0@lo:256: 10000000:01000000:3.0:1788448283.030968:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448283.030979:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.030999:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448283.031009:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788448283.031011:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788448283.031014:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788448283.031039:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.031047:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.031055:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448283.031069:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826233088:0@lo:101: 00000100:00100000:3.0:1788448283.031099:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.031126:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.031424:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233088 00000100:00100000:0.0:1788448283.031430:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233088 00000100:00100000:0.0:1788448283.031475:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448283.031484:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826233088:12345-0@lo:101: 00010000:00010000:0.0:1788448283.031495:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448283.031508:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8034fb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.031529:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.031539:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.031547:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030e00, rc 0) 00000100:00100000:0.0:1788448283.031581:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826233088:12345-0@lo:101: Request processed in 99us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.031587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448283.031698:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826233088:0@lo:101: 00010000:00010000:0.0:1788448283.031709:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.031717:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.032888:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826233216:0@lo:501: 00000100:00100000:0.0:1788448283.032945:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.032978:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.032999:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233216 00000100:00100000:0.0:1788448283.033003:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233216 00000100:00100000:0.0:1788448283.035063:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448283.035079:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826233216:12345-0@lo:501: 00000100:00100000:0.0:1788448283.035274:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826233216:12345-0@lo:501: Request processed in 191us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.035282:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788448283.035369:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826233216:0@lo:501: 00000100:00100000:3.0:1788448283.035420:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826233344:0@lo:503: 00000100:00100000:3.0:1788448283.035465:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.042687:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448283.042994:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233344 00000100:00100000:2.0:1788448283.043003:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233344 00000100:00100000:2.0:1788448283.043061:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788448283.043073:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826233344:12345-0@lo:503: 00000100:00100000:2.0:1788448283.043221:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826233344:12345-0@lo:503: Request processed in 150us (7755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.043229:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788448283.044991:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826233344:0@lo:503: 00000100:00100000:2.0:1788448283.045832:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8529:1875323826233472:0@lo:502: 00000100:00100000:2.0:1788448283.045917:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.045953:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233472 00000100:00100000:2.0:1788448283.045959:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233472 00000100:00100000:2.0:1788448283.045993:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788448283.046001:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8529:x1875323826233472:12345-0@lo:502: 00000100:00100000:2.0:1788448283.046119:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8529:x1875323826233472:12345-0@lo:502: Request processed in 117us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.046126:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788448283.046179:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ecee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448283.046194:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8529:1875323826233472:0@lo:502: 00000020:01000000:2.0:1788448283.046216:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448283.046223:0:8529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788448283.046230:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448283.046237:0:8529:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788448283.046242:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788448283.046245:0:8529:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:2.0:1788448283.046265:0:8529:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788448283.046267:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448283.046282:0:8529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fc1b5d58000) 00000020:00000080:2.0:1788448283.046303:0:8529:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788448283.046307:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788448283.046386:0:8529:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788448283.046392:0:8529:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788448283.046398:0:8529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b803510 00010000:00080000:2.0:1788448283.046424:0:8529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1bf726800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1788448283.046655:0:8529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788448283.054550:0:8529:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788448283.054573:0:8529:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788448283.054757:0:8529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448283.055097:0:8529:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448283.055185:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788448283.055257:0:8529:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788448283.057346:0:8530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448283.057353:0:8530:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788448283.060252:0:8529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448283.060267:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788448283.060309:0:8529:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788448283.060329:0:8529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b803517 00000100:00080000:0.0:1788448283.060340:0:8529:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448283.060345:0:8529:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc1bf726800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448283.060380:0:8529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1c11cc380 x1875323826233600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448283.060402:0:8529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788448283.060468:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448283.060472:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448283.060474:0:8529:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788448283.060477:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448283.060480:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448283.060482:0:8529:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448283.060485:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448283.060487:0:8529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788448283.060521:0:8529:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8529:1875323826233728:0@lo:502: 00000100:00100000:0.0:1788448283.060594:0:8529:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.060661:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826233600:0@lo:8: 00000100:00100000:1.0:1788448283.060702:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.060984:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233728 00000100:00100000:1.0:1788448283.060992:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233728 00000100:00100000:1.0:1788448283.061039:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448283.061048:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8529:x1875323826233728:12345-0@lo:502: 00000100:00100000:3.0:1788448283.061297:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826234240:0@lo:400: 00000100:00100000:3.0:1788448283.061328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.061333:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826233856:0@lo:400: 00000100:00100000:3.0:1788448283.061361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826233984:0@lo:400: 00000100:00100000:2.0:1788448283.061363:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.061383:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826234368:0@lo:400: 00000100:00100000:3.0:1788448283.061384:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.061406:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826234496:0@lo:400: 00000100:00100000:2.0:1788448283.061406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.061430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.061433:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826234112:0@lo:400: 00000100:00100000:2.0:1788448283.061455:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.061456:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234240 00000100:00100000:3.0:1788448283.061459:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234240 00000100:00100000:3.0:1788448283.061478:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233984 00000100:00100000:3.0:1788448283.061481:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233984 00000100:00100000:3.0:1788448283.061495:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448283.061501:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826234240:12345-0@lo:400: 00000100:00100000:3.0:1788448283.061552:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826234240:12345-0@lo:400: Request processed in 51us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.061558:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448283.061573:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448283.061578:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826233984:12345-0@lo:400: 00000100:00100000:3.0:1788448283.061607:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826233984:12345-0@lo:400: Request processed in 29us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.061613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448283.063411:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233856 00000100:00100000:3.0:1788448283.063419:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233856 00000100:00100000:3.0:1788448283.063444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234368 00000100:00100000:3.0:1788448283.063447:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234368 00000100:00100000:3.0:1788448283.063469:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234496 00000100:00100000:3.0:1788448283.063472:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234496 00000100:00100000:3.0:1788448283.063483:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234112 00000100:00100000:3.0:1788448283.063486:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234112 00000100:00100000:3.0:1788448283.063500:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448283.063507:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826233856:12345-0@lo:400: 00000100:00100000:3.0:1788448283.063587:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826233856:12345-0@lo:400: Request processed in 81us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.063593:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448283.063634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448283.063640:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826234368:12345-0@lo:400: 00000100:00100000:3.0:1788448283.063665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826234368:12345-0@lo:400: Request processed in 26us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.063671:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448283.063679:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448283.063684:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826234496:12345-0@lo:400: 00000100:00100000:3.0:1788448283.063703:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826234496:12345-0@lo:400: Request processed in 20us (2273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.063708:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448283.063716:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448283.063721:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826234112:12345-0@lo:400: 00000100:00100000:3.0:1788448283.063744:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826234112:12345-0@lo:400: Request processed in 23us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.063749:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788448283.064190:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191315880 x1875323826234112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.064204:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826234112:0@lo:400: 00000100:00100000:3.0:1788448283.064239:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191317800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826233984:0@lo:400: 00010000:00080000:3.0:1788448283.064249:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4895180 x1875323826234496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.064257:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826234496:0@lo:400: 00010000:00080000:3.0:1788448283.064278:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191317480 x1875323826233856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.064298:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826233856:0@lo:400: 00010000:00080000:3.0:1788448283.064315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191314700 x1875323826234368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.064322:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826234368:0@lo:400: 00000100:00080000:2.0:1788448283.064403:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448283.064408:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448283.064431:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826234240:0@lo:400: 00000100:00100000:2.0:1788448283.065068:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826233600 00000100:00100000:2.0:1788448283.065075:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826233600 00000100:00100000:2.0:1788448283.065103:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448283.065110:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826233600:12345-0@lo:8: 00010000:00080000:2.0:1788448283.065137:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1788448283.065176:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80351e 00002000:00100000:2.0:1788448283.065207:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fc1bf722000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788448283.065211:0:8431:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788448283.065214:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788448283.065282:0:8431:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788448283.065518:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788448283.065544:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf724000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448283.065619:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826233600:12345-0@lo:8: Request processed in 508us (4915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.065626:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448283.066033:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:8529:x1875323826233728:12345-0@lo:502: Request processed in 4984us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448283.066043:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1788448283.066096:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1c11cc380 x1875323826233600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448283.066107:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448283.066124:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788448283.066131:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788448283.066136:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788448283.066139:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf726800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788448283.066204:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788448283.066211:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826233600:0@lo:8: 00000004:00080000:1.0:1788448283.066236:0:8530:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448283.066301:0:8530:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 200411418397ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448283.066306:0:8530:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788448283.068501:0:8529:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.068536:0:8529:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8529:1875323826233728:0@lo:502: 00000020:01000000:0.0:1788448283.068574:0:8529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448283.068582:0:8529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448283.068585:0:8529:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788448283.068590:0:8529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000100:00100000:2.0:1788448283.069706:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826234624:0@lo:700: 00000100:00100000:2.0:1788448283.069776:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.069812:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece240 going to sleep for 11 seconds 00000020:01000000:1.0:1788448283.069837:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788448283.069863:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788448283.069873:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448283.069914:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448283.069925:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788448283.069928:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc190ac6000 from 30 10000000:01000000:1.0:1788448283.069931:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788448283.069955:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448283.069963:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448283.069972:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448283.069984:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826234752:0@lo:101: 00000100:00100000:0.0:1788448283.069995:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234624 00000100:00100000:0.0:1788448283.070002:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234624 00000100:00100000:1.0:1788448283.070025:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.070053:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19284b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.070058:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448283.070067:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8531:x1875323826234624:12345-0@lo:700: 00000100:00100000:0.0:1788448283.070100:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1875323826234880:0@lo:700: 00000100:00080000:2.0:1788448283.070138:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448283.070138:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.070176:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448283.070188:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234880 00000100:00100000:1.0:1788448283.070192:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234880 00000100:00100000:1.0:1788448283.070260:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448283.070268:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1875323826234880:12345-0@lo:700: 00000004:00080000:0.0:1788448283.070433:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1788448283.070949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826234752 00000100:00100000:3.0:1788448283.070955:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826234752 00000100:00100000:3.0:1788448283.070985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788448283.070991:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826234752:12345-0@lo:101: 00010000:00010000:3.0:1788448283.071000:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448283.071014:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803525 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.071049:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.071059:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.071067:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:3.0:1788448283.071110:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826234752:12345-0@lo:101: Request processed in 119us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.071117:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788448283.071174:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a69180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826234752:0@lo:101: 00010000:00010000:3.0:1788448283.071188:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448283.071209:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448283.071266:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235008:0@lo:501: 00000100:00100000:3.0:1788448283.071295:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.071318:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.071331:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235008 00000100:00100000:3.0:1788448283.071334:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235008 00000100:00100000:3.0:1788448283.071354:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788448283.071360:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826235008:12345-0@lo:501: 00000100:00100000:3.0:1788448283.071463:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826235008:12345-0@lo:501: Request processed in 102us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.071470:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788448283.071591:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235008:0@lo:501: 00000100:00100000:1.0:1788448283.071621:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235136:0@lo:503: 00000100:00100000:1.0:1788448283.071659:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.071682:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19284b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.072028:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235136 00000100:00100000:3.0:1788448283.072034:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235136 00000100:00100000:3.0:1788448283.072056:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788448283.072063:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826235136:12345-0@lo:503: 00000100:00100000:3.0:1788448283.072168:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826235136:12345-0@lo:503: Request processed in 93us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.072176:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448283.072196:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235136:0@lo:503: 00000100:00100000:1.0:1788448283.072985:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8532:1875323826235264:0@lo:502: 00000100:00100000:1.0:1788448283.073034:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.073069:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.073119:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235264 00000100:00100000:3.0:1788448283.073124:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235264 00000100:00100000:3.0:1788448283.073195:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788448283.073204:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8532:x1875323826235264:12345-0@lo:502: 00000100:00100000:3.0:1788448283.073295:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8532:x1875323826235264:12345-0@lo:502: Request processed in 93us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.073311:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788448283.073381:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8532:1875323826235264:0@lo:502: 00000100:00100000:1.0:1788448283.073422:0:8532:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8532:1875323826235392:0@lo:502: 00000100:00100000:1.0:1788448283.073457:0:8532:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.074698:0:8532:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.074948:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235392 00000100:00100000:0.0:1788448283.074955:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235392 00000100:00100000:0.0:1788448283.074991:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448283.074998:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8532:x1875323826235392:12345-0@lo:502: 00000100:00100000:0.0:1788448283.075383:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:8532:x1875323826235392:12345-0@lo:502: Request processed in 384us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.075390:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788448283.075393:0:8532:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8532:1875323826235392:0@lo:502: 00000040:00080000:1.0:1788448283.075421:0:8532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788448283.075494:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788448283.075516:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448283.075524:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.075541:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448283.075552:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448283.075554:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc190ac6000 from 5 10000000:01000000:0.0:1788448283.075557:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448283.075584:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.075591:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.075599:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.075613:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235520:0@lo:101: 00000100:00100000:0.0:1788448283.076757:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.077337:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.077359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235520 00000100:00100000:0.0:1788448283.077364:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235520 00000100:00100000:0.0:1788448283.077417:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448283.077426:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826235520:12345-0@lo:101: 00010000:00010000:0.0:1788448283.077439:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448283.077455:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803533 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.077480:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.077507:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.077515:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031600, rc 0) 00000100:00100000:0.0:1788448283.077556:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826235520:12345-0@lo:101: Request processed in 132us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.077562:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448283.077733:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235520:0@lo:101: 00010000:00010000:0.0:1788448283.077750:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.077759:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.077904:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235648:0@lo:256: 00000100:00100000:0.0:1788448283.077937:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.077961:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.077975:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235648 00000100:00100000:0.0:1788448283.077979:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235648 00000100:00100000:0.0:1788448283.078000:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448283.078007:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826235648:12345-0@lo:256: 20000000:01000000:0.0:1788448283.078019:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448283.078144:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448283.078149:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788448283.078229:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826235648:12345-0@lo:256: Request processed in 222us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.078236:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448283.078271:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235648:0@lo:256: 10000000:01000000:0.0:1788448283.078309:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448283.078316:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078324:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448283.078331:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788448283.078334:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788448283.078336:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788448283.078353:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078359:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078366:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.078377:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235776:0@lo:101: 00000100:00100000:0.0:1788448283.078401:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.078420:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.078432:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235776 00000100:00100000:0.0:1788448283.078435:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235776 00000100:00100000:0.0:1788448283.078456:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788448283.078461:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826235776:12345-0@lo:101: 00010000:00010000:0.0:1788448283.078468:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448283.078476:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803541 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078496:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078504:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078511:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031e00, rc 0) 00000100:00100000:0.0:1788448283.078538:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826235776:12345-0@lo:101: Request processed in 77us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.078544:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788448283.078571:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235776:0@lo:101: 00010000:00010000:0.0:1788448283.078582:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.078589:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.079555:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235904:0@lo:501: 00000100:00100000:0.0:1788448283.079590:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.079626:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908403c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.079641:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826235904 00000100:00100000:0.0:1788448283.079645:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826235904 00000100:00100000:0.0:1788448283.079678:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788448283.079685:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826235904:12345-0@lo:501: 00000100:00100000:0.0:1788448283.079912:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826235904:12345-0@lo:501: Request processed in 225us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.079919:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448283.084047:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826235904:0@lo:501: 00000100:00100000:1.0:1788448283.084110:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826236032:0@lo:503: 00000100:00100000:1.0:1788448283.084193:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.084227:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448283.084246:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236032 00000100:00100000:1.0:1788448283.084257:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236032 00000100:00100000:1.0:1788448283.084301:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788448283.084309:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826236032:12345-0@lo:503: 00000100:00100000:1.0:1788448283.084405:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826236032:12345-0@lo:503: Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448283.084412:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788448283.084455:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826236032:0@lo:503: 40000000:02000000:1.0:1788448283.084681:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788448283.091397:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0000_UUID+5:8440:x1875323826234880:12345-0@lo:700: Request processed in 21123us (21250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448283.091413:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788448283.092314:0:8440:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1c11cca80 x1875323826234880/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448283.092437:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8440:1875323826234880:0@lo:700: 40000000:02000000:0.0:1788448283.092455:0:8440:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:2.0:1788448283.092744:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8534:1875323826236160:0@lo:502: 00000100:00100000:2.0:1788448283.092813:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.092912:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.092995:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236160 00000100:00100000:3.0:1788448283.093002:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236160 00000100:00100000:3.0:1788448283.093049:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788448283.093060:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:8534:x1875323826236160:12345-0@lo:502: 00000100:00100000:3.0:1788448283.093234:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:8534:x1875323826236160:12345-0@lo:502: Request processed in 171us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.093242:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448283.093244:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8534:1875323826236160:0@lo:502: 00000020:01000000:2.0:1788448283.093270:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448283.093277:0:8534:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788448283.093284:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448283.093291:0:8534:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788448283.093297:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788448283.093301:0:8534:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:2.0:1788448283.093322:0:8534:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788448283.093327:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448283.093341:0:8534:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fc1b5d5b370) 00000020:00000080:2.0:1788448283.093362:0:8534:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788448283.093366:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788448283.093454:0:8534:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788448283.093459:0:8534:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788448283.093465:0:8534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b803556 00010000:00080000:2.0:1788448283.093493:0:8534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1bf74f000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1788448283.094195:0:8534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:2.0:1788448283.112750:0:8534:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788448283.112772:0:8534:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788448283.112982:0:8534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448283.113281:0:8534:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448283.113383:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788448283.113465:0:8534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:0.0:1788448283.114670:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788448283.114788:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8531:x1875323826234624:12345-0@lo:700: Request processed in 44718us (45008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.114801:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788448283.114939:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1ba1f0e00 x1875323826234624/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.114954:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826234624:0@lo:700: 00000040:00080000:1.0:1788448283.117041:0:8536:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448283.117050:0:8536:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788448283.119858:0:8534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788448283.119874:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788448283.119952:0:8534:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788448283.119975:0:8534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b80355d 00000100:00080000:0.0:1788448283.119984:0:8534:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448283.119990:0:8534:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc1bf74f000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448283.120021:0:8534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1c11cca80 x1875323826236288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448283.120046:0:8534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788448283.120107:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826236288:0@lo:8: 00000020:01000000:0.0:1788448283.120108:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448283.120115:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448283.120118:0:8534:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788448283.120121:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448283.120126:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448283.120128:0:8534:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448283.120132:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448283.120134:0:8534:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788448283.120173:0:8534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8534:1875323826236416:0@lo:502: 00000100:00100000:1.0:1788448283.120206:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.120225:0:8534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.120264:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236288 00000100:00100000:0.0:1788448283.120275:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236288 00000100:00100000:0.0:1788448283.120310:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448283.120316:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826236288:12345-0@lo:8: 00010000:00080000:0.0:1788448283.120337:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1788448283.120358:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b803564 00002000:00100000:0.0:1788448283.120369:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fc1ba27d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788448283.120374:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788448283.120377:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788448283.120443:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788448283.120464:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba27f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448283.120502:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826236288:12345-0@lo:8: Request processed in 185us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.120509:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448283.120531:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236416 00000100:00100000:0.0:1788448283.120535:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236416 00010000:00080000:1.0:1788448283.120546:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1c11cca80 x1875323826236288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448283.120558:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788448283.120562:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1788448283.120565:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:0.0:1788448283.120572:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:8534:x1875323826236416:12345-0@lo:502: 00000100:00080000:1.0:1788448283.120574:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788448283.120581:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788448283.120584:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf74f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788448283.120595:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788448283.120660:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:8534:x1875323826236416:12345-0@lo:502: Request processed in 90us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.120667:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788448283.120700:0:8534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190840e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448283.120710:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826236288:0@lo:8: 00000100:00100000:0.0:1788448283.120714:0:8534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:8534:1875323826236416:0@lo:502: 00000020:01000000:0.0:1788448283.120741:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448283.120746:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448283.120747:0:8534:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788448283.120752:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788448283.120807:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788448283.120852:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788448283.120862:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.120871:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448283.120900:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788448283.120903:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc19ebe99b8 from 1 10000000:01000000:0.0:1788448283.120907:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788448283.120930:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.120938:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.120946:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.120958:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826236544:0@lo:101: 00000100:00100000:0.0:1788448283.120983:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.121005:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190840e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.121017:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236544 00000100:00100000:0.0:1788448283.121020:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236544 00000100:00100000:0.0:1788448283.121041:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788448283.121047:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826236544:12345-0@lo:101: 00010000:00010000:0.0:1788448283.121055:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448283.121066:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80356b expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.121096:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.121108:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.121117:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152fa00, rc 0) 00000100:00100000:0.0:1788448283.121147:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826236544:12345-0@lo:101: Request processed in 99us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.121154:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788448283.121195:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826236544:0@lo:101: 00010000:00010000:0.0:1788448283.121207:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.121215:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448283.121257:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826236672:0@lo:501: 00000100:00100000:0.0:1788448283.121282:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.121294:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190840e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.121306:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236672 00000100:00100000:0.0:1788448283.121309:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236672 00000100:00100000:0.0:1788448283.121327:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788448283.121333:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826236672:12345-0@lo:501: 00000100:00100000:0.0:1788448283.121385:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826236672:12345-0@lo:501: Request processed in 52us (102us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448283.121392:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788448283.121428:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826236672:0@lo:501: 10000000:01000000:0.0:1788448283.121446:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788448283.121451:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448283.121459:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448283.122435:0:8536:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448283.122503:0:8536:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 200467621014ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448283.122520:0:8536:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788448283.123777:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826236800:0@lo:13: 00000100:00100000:3.0:1788448283.123838:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448283.123958:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236800 00000100:00100000:0.0:1788448283.123966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236800 00000100:00100000:0.0:1788448283.124007:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448283.124016:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826236800:12345-0@lo:13: 00002000:00000024:0.0:1788448283.124046:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000004:00080000:1.0:1788448283.124127:0:8531:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788448283.124150:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826236928:0@lo:7: 00000100:00100000:1.0:1788448283.124195:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448283.124218:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.129800:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826236800:12345-0@lo:13: Request processed in 5775us (5952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.129815:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448283.129867:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826236928 00000100:00100000:0.0:1788448283.129875:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826236928 00000100:00100000:0.0:1788448283.129928:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448283.129937:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1875323826236928:12345-0@lo:7: 00010000:00080000:3.0:1788448283.130482:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a69c00 x1875323826236800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.130505:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826236800:0@lo:13: 00000004:00080000:1.0:1788448283.138444:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788448283.141562:0:8537:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788448283.141594:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237184:0@lo:7: 00000100:00100000:3.0:1788448283.141661:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.141689:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448283.142079:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826237056:0@lo:13: 00000100:00100000:3.0:1788448283.142106:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.142989:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448283.143001:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788448283.143373:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237184 00000100:00100000:1.0:1788448283.143381:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237184 00000100:00100000:3.0:1788448283.143669:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448283.143681:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237056 00000100:00100000:3.0:1788448283.143688:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8537:x1875323826237184:12345-0@lo:7: 00000100:00100000:0.0:1788448283.143690:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237056 00000100:00100000:0.0:1788448283.143725:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448283.143735:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826237056:12345-0@lo:13: 00002000:00000024:0.0:1788448283.143751:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:0.0:1788448283.143829:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826237056:12345-0@lo:13: Request processed in 96us (1721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.143838:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788448283.143859:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4895f80 x1875323826237056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.143903:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826237056:0@lo:13: 00000100:00080000:2.0:1788448283.144780:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788448283.151873:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788448283.151908:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788448283.152007:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1875323826236928:12345-0@lo:7: Request processed in 22065us (27806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.152017:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788448283.152733:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a68000 x1875323826236928/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448283.152748:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826236928:0@lo:7: 00000004:00080000:2.0:1788448283.152761:0:8531:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788448283.152797:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826237312:0@lo:5: 00000100:00100000:2.0:1788448283.152834:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.152873:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.153229:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237312 00000100:00100000:0.0:1788448283.153236:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237312 00000100:00100000:0.0:1788448283.153291:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448283.153303:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1875323826237312:12345-0@lo:5: 00002000:00080000:0.0:1788448283.153500:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788448283.153866:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8531:x1875323826237312:12345-0@lo:5: Request processed in 566us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.153875:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788448283.154780:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1ba1f1180 x1875323826237312/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448283.154814:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826237312:0@lo:5: 00000004:00080000:2.0:1788448283.154826:0:8531:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788448283.154864:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826237440:0@lo:5: 00000100:00100000:2.0:1788448283.154923:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.154948:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.154950:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237440 00000100:00100000:0.0:1788448283.154958:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237440 00000100:00100000:0.0:1788448283.155007:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448283.155017:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8531:x1875323826237440:12345-0@lo:5: 00002000:00080000:0.0:1788448283.155051:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00002000:00080000:2.0:1788448283.163030:0:8539:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788448283.163038:0:8539:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788448283.163125:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8537:x1875323826237184:12345-0@lo:7: Request processed in 19438us (21459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.163136:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788448283.166262:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4894700 x1875323826237184/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.166278:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237184:0@lo:7: 00000004:00080000:3.0:1788448283.166292:0:8537:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788448283.166330:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237568:0@lo:5: 00000100:00100000:0.0:1788448283.166679:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8531:x1875323826237440:12345-0@lo:5: Request processed in 11662us (11755us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788448283.166690:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448283.167812:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.167850:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.168701:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237568 00000100:00100000:0.0:1788448283.168712:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237568 00000100:00100000:0.0:1788448283.168765:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448283.168778:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8537:x1875323826237568:12345-0@lo:5: 00002000:00080000:0.0:1788448283.168809:0:8434:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788448283.168814:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00010000:00080000:2.0:1788448283.169803:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1ba1f1180 x1875323826237440/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448283.169822:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8531:1875323826237440:0@lo:5: 00000004:00080000:2.0:1788448283.169834:0:8531:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1788448283.169874:0:8531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1875323826237696:0@lo:900: 00000100:00100000:2.0:1788448283.170098:0:8531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.170126:0:8531:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.170794:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237696 00000100:00100000:0.0:1788448283.170802:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237696 00000100:00100000:0.0:1788448283.171126:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448283.171136:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1875323826237696:12345-0@lo:900: 00000100:00100000:0.0:1788448283.171217:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8531:x1875323826237696:12345-0@lo:900: Request processed in 82us (1118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448283.171227:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788448283.171645:0:8531:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc19137fb80 x1875323826237696/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448283.171659:0:8531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8531:1875323826237696:0@lo:900: 00000001:00080000:3.0:1788448283.173075:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788448283.173087:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788448283.173097:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788448283.173760:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8537:x1875323826237568:12345-0@lo:5: Request processed in 4981us (5948us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788448283.173771:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788448283.174186:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4894700 x1875323826237568/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.174198:0:8537:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788448283.174205:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237568:0@lo:5: 00000004:00080000:3.0:1788448283.174219:0:8537:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788448283.174263:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237824:0@lo:700: 00000100:00100000:3.0:1788448283.174313:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.174356:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.174390:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237824 00000100:00100000:0.0:1788448283.174398:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237824 00000100:00100000:0.0:1788448283.174438:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448283.174449:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8537:x1875323826237824:12345-0@lo:700: 00000100:00100000:3.0:1788448283.193235:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8537:x1875323826237824:12345-0@lo:700: Request processed in 18777us (18910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448283.193266:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788448283.193744:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4894700 x1875323826237824/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448283.193760:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237824:0@lo:700: 00000004:02000040:0.0:1788448283.201395:0:8537:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788448283.208808:0:8537:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237952:0@lo:5: 00000100:00100000:0.0:1788448283.208911:0:8537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448283.208946:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826237952 00000100:00100000:3.0:1788448283.208954:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826237952 00000100:00100000:0.0:1788448283.208963:0:8537:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448283.209010:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448283.209020:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8537:x1875323826237952:12345-0@lo:5: 00002000:00080000:0.0:1788448283.215960:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788448283.215977:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:0.0:1788448283.218284:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8537:x1875323826237952:12345-0@lo:5: Request processed in 9259us (9368us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788448283.218297:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788448283.221923:0:8537:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1c11cce00 x1875323826237952/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448299 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448283.221946:0:8537:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8537:1875323826237952:0@lo:5: 00000004:00080000:3.0:1788448283.221961:0:8537:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00000100:00100000:1.0:1788448283.326220:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826238080:0@lo:41: 00000100:00100000:1.0:1788448283.326299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448283.326431:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238080 00000100:00100000:2.0:1788448283.326439:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238080 00000100:00100000:2.0:1788448283.326490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448283.326500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826238080:12345-0@lo:41: 00000004:00000024:2.0:1788448283.326546:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788448283.326595:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826238080:12345-0@lo:41: Request processed in 96us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448283.326603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448283.326738:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826238080:0@lo:41: 00010000:00010000:2.0:1788448283.647170:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448284.673364:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448285.694053:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448286.399462:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826238208:0@lo:41: 00000100:00100000:1.0:1788448286.399550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448286.400342:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238208 00000100:00100000:2.0:1788448286.400352:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238208 00000100:00100000:2.0:1788448286.400407:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448286.400417:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826238208:12345-0@lo:41: 00000004:00000024:2.0:1788448286.400449:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788448286.401664:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826238208:12345-0@lo:41: Request processed in 1242us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448286.401676:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448286.401848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826238208:0@lo:41: 00010000:00010000:2.0:1788448286.721808:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448287.742329:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448287.835288:0:8808:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788448288.451004:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826238336:0@lo:41: 00000100:00100000:2.0:1788448288.451068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448288.451154:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238336 00000100:00100000:2.0:1788448288.451162:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238336 00000100:00100000:2.0:1788448288.451204:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448288.451213:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826238336:12345-0@lo:41: 00000004:00000024:2.0:1788448288.451245:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788448288.451288:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826238336:12345-0@lo:41: Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448288.451295:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448288.451342:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826238336:0@lo:41: 00000100:00100000:3.0:1788448288.453935:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826238464:0@lo:13: 00000100:00100000:3.0:1788448288.454004:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448288.454108:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238464 00000100:00100000:3.0:1788448288.454116:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238464 00000100:00100000:3.0:1788448288.454185:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448288.454194:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826238464:12345-0@lo:13: 00002000:00000024:3.0:1788448288.454219:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448288.454263:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826238464:12345-0@lo:13: Request processed in 71us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448288.454270:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788448288.454290:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448288.454322:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4896d80 x1875323826238464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448288.454340:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826238464:0@lo:13: 00000100:00100000:3.0:1788448288.456925:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448288.456947:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826238592:0@lo:13: 00000100:00100000:3.0:1788448288.457012:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448288.457104:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238592 00000100:00100000:3.0:1788448288.457113:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238592 00000100:00100000:3.0:1788448288.457179:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448288.457188:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826238592:12345-0@lo:13: 00002000:00000024:3.0:1788448288.457209:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448288.457253:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826238592:12345-0@lo:13: Request processed in 66us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448288.457260:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788448288.457287:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448288.457313:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc19137fb80 x1875323826238592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448288.457323:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788448288.457342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826238592:0@lo:13: 00000100:00100000:1.0:1788448288.458038:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826238720:0@lo:400: 00000100:00100000:1.0:1788448288.458079:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448288.458104:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826239232:0@lo:400: 00000100:00100000:1.0:1788448288.458143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448288.458165:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788448288.458170:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826238848:0@lo:400: 00000100:00100000:1.0:1788448288.458193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448288.458210:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826239360:0@lo:400: 00000100:00100000:1.0:1788448288.458231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448288.458423:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239232 00000100:00100000:2.0:1788448288.458430:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239232 00000100:00100000:2.0:1788448288.458487:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238848 00000100:00100000:2.0:1788448288.458490:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238848 00000100:00100000:2.0:1788448288.458511:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239360 00000100:00100000:2.0:1788448288.458513:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239360 00000100:00100000:2.0:1788448288.458530:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448288.458536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826239232:12345-0@lo:400: 00000100:00100000:2.0:1788448288.458579:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826239232:12345-0@lo:400: Request processed in 43us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448288.458586:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448288.458600:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448288.458607:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826238848:12345-0@lo:400: 00000100:00100000:2.0:1788448288.458632:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826238848:12345-0@lo:400: Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448288.458638:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448288.458649:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788448288.458655:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826239360:12345-0@lo:400: 00000100:00100000:2.0:1788448288.458681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826239360:12345-0@lo:400: Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448288.458686:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448288.459052:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238720 00000100:00100000:0.0:1788448288.459057:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238720 00000100:00100000:0.0:1788448288.459251:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788448288.459283:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3647:x1875323826238720:12345-0@lo:400: 00000100:00100000:0.0:1788448288.459321:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3647:x1875323826238720:12345-0@lo:400: Request processed in 63us (1242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448288.459328:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788448288.459398:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826239104:0@lo:400: 00000100:00100000:0.0:1788448288.459427:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448288.459451:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448288.459458:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826238976:0@lo:400: 00000100:00100000:0.0:1788448288.459482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788448288.459723:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448288.459727:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448288.459753:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a69c00 x1875323826238848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448288.459786:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826238848:0@lo:400: 00010000:00080000:1.0:1788448288.459802:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a6b100 x1875323826239360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448288.459810:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826239360:0@lo:400: 00000100:00100000:1.0:1788448288.459819:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826238720:0@lo:400: 00010000:00080000:1.0:1788448288.459829:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a68a80 x1875323826239232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448288.459837:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826239232:0@lo:400: 00000100:00100000:0.0:1788448288.460399:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826238976 00000100:00100000:0.0:1788448288.460406:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826238976 00000100:00100000:1.0:1788448288.460616:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239104 00000100:00100000:1.0:1788448288.460621:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239104 00000100:00100000:1.0:1788448288.460646:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448288.460652:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826239104:12345-0@lo:400: 00000100:00100000:1.0:1788448288.460714:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826239104:12345-0@lo:400: Request processed in 61us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448288.460720:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448288.460761:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448288.460770:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826238976:12345-0@lo:400: 00000100:00100000:0.0:1788448288.460805:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826238976:12345-0@lo:400: Request processed in 37us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448288.460810:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448288.460842:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826238976:0@lo:400: 00010000:00080000:0.0:1788448288.460855:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a69180 x1875323826239104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448288.460864:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a69180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826239104:0@lo:400: 00000001:00080000:0.0:1788448288.462672:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788448288.767208:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448288.876980:0:8860:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448288.877207:0:8860:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448289.790313:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448290.827123:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448291.519438:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448291.519464:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826239488:0@lo:41: 00000100:00100000:2.0:1788448291.519543:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448291.520847:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239488 00000100:00100000:3.0:1788448291.520858:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239488 00000100:00100000:3.0:1788448291.520957:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448291.520969:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826239488:12345-0@lo:41: 00000004:00000024:3.0:1788448291.521017:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788448291.521087:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826239488:12345-0@lo:41: Request processed in 121us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448291.521095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448291.521250:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826239488:0@lo:41: 00000020:00000004:0.0:1788448291.731352:0:8961:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448291.731535:0:8961:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448291.840922:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788448292.856040:0:9009:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448292.856049:0:9009:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788448292.869814:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448293.566078:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826239744:0@lo:13: 00000100:00100000:3.0:1788448293.566154:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448293.566223:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239744 00000100:00100000:3.0:1788448293.566230:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239744 00000100:00100000:3.0:1788448293.566288:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448293.566298:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826239744:12345-0@lo:13: 00002000:00000024:3.0:1788448293.566326:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448293.566367:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826239744:12345-0@lo:13: Request processed in 70us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448293.566375:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788448293.566429:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb426300 x1875323826239744/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448293.566446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826239744:0@lo:13: 00000100:00100000:1.0:1788448293.567538:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826239616:0@lo:13: 00000100:00100000:1.0:1788448293.567585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788448293.567628:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448293.567638:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826239872:0@lo:41: 00000100:00100000:1.0:1788448293.567666:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448293.567699:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239872 00000100:00100000:1.0:1788448293.567705:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239872 00000100:00100000:1.0:1788448293.567753:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788448293.567760:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826239872:12345-0@lo:41: 00000004:00000024:1.0:1788448293.567788:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788448293.567829:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826239872:12345-0@lo:41: Request processed in 69us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448293.567835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788448293.567871:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826239872:0@lo:41: 00000100:00100000:1.0:1788448293.567917:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826239616 00000100:00100000:1.0:1788448293.567921:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826239616 00000100:00100000:1.0:1788448293.567950:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448293.567957:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826239616:12345-0@lo:13: 00002000:00000024:1.0:1788448293.567968:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448293.568001:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826239616:12345-0@lo:13: Request processed in 45us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448293.568007:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788448293.568022:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448293.568040:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4895880 x1875323826239616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448293.568049:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788448293.568064:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826239616:0@lo:13: 00000100:00100000:0.0:1788448293.568244:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826240384:0@lo:400: 00000100:00100000:0.0:1788448293.568275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448293.568297:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448293.568302:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826240256:0@lo:400: 00000100:00100000:0.0:1788448293.568325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448293.568348:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240384 00000100:00100000:0.0:1788448293.568352:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240384 00000100:00100000:0.0:1788448293.568379:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448293.568807:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240256 00000100:00100000:2.0:1788448293.568813:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240256 00000100:00100000:2.0:1788448293.568836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448293.568844:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826240256:12345-0@lo:400: 00000100:00100000:2.0:1788448293.568910:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826240256:12345-0@lo:400: Request processed in 66us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448293.568916:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448293.568947:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826240256:0@lo:400: 00000100:00100000:3.0:1788448293.569174:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826240128:0@lo:400: 00000100:00100000:3.0:1788448293.569209:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448293.569228:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826240640:0@lo:400: 00000100:00100000:3.0:1788448293.569248:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448293.569274:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788448293.569280:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826240000:0@lo:400: 00000100:00100000:3.0:1788448293.569308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448293.569338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826240512:0@lo:400: 00000100:00100000:3.0:1788448293.569361:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448293.569381:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448293.569388:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788448293.569469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240128 00000100:00100000:3.0:1788448293.569473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240128 00000100:00100000:0.0:1788448293.569489:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826240384:12345-0@lo:400: 00000100:00100000:3.0:1788448293.569491:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448293.569495:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240640 00000100:00100000:3.0:1788448293.569498:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240640 00000100:00100000:0.0:1788448293.569533:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826240384:12345-0@lo:400: Request processed in 1147us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448293.569540:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448293.569555:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240512 00000100:00100000:0.0:1788448293.569559:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240512 00000100:00100000:1.0:1788448293.569634:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448293.569645:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826240128:12345-0@lo:400: 00000100:00100000:1.0:1788448293.569686:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826240128:12345-0@lo:400: Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448293.569693:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1788448293.569724:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf782d80 x1875323826240128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448293.569743:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826240128:0@lo:400: 00000100:00100000:1.0:1788448293.569778:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240000 00000100:00100000:1.0:1788448293.569782:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240000 00000100:00100000:1.0:1788448293.569812:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788448293.569820:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3646:x1875323826240000:12345-0@lo:400: 00000100:00100000:1.0:1788448293.569858:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3646:x1875323826240000:12345-0@lo:400: Request processed in 38us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448293.569863:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788448293.569917:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826240000:0@lo:400: 00000100:00100000:3.0:1788448293.569968:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448293.569984:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448293.569987:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826240640:12345-0@lo:400: 00000100:00100000:0.0:1788448293.569992:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448293.569998:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826240512:12345-0@lo:400: 00000100:00100000:3.0:1788448293.570029:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826240640:12345-0@lo:400: Request processed in 54us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448293.570030:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826240512:12345-0@lo:400: Request processed in 33us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448293.570037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448293.570046:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1788448293.570068:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf783100 x1875323826240384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448293.570078:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826240384:0@lo:400: 00010000:00080000:0.0:1788448293.570128:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf781880 x1875323826240512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448293.570147:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826240512:0@lo:400: 00010000:00080000:0.0:1788448293.570163:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf780380 x1875323826240640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448293.570169:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826240640:0@lo:400: 00000100:00080000:1.0:1788448293.572499:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448293.572507:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788448293.887171:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448294.910588:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448295.934386:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448296.643526:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826240768:0@lo:41: 00000100:00100000:3.0:1788448296.643596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448296.643664:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240768 00000100:00100000:3.0:1788448296.643672:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240768 00000100:00100000:3.0:1788448296.643715:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448296.643724:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826240768:12345-0@lo:41: 00000004:00000024:3.0:1788448296.643953:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788448296.644038:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826240768:12345-0@lo:41: Request processed in 313us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448296.644045:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448296.648634:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826240768:0@lo:41: 00010000:00010000:1.0:1788448296.959601:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448297.986988:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448298.686263:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826240896:0@lo:41: 00000100:00100000:0.0:1788448298.686341:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448298.686408:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448298.686417:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826241024:0@lo:13: 00000100:00100000:0.0:1788448298.686443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448298.686842:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826240896 00000100:00100000:0.0:1788448298.686850:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826240896 00000100:00100000:0.0:1788448298.686916:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448298.686926:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826240896:12345-0@lo:41: 00000004:00000024:0.0:1788448298.687020:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788448298.687114:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826240896:12345-0@lo:41: Request processed in 189us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448298.687120:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448298.687178:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826240896:0@lo:41: 00000100:00100000:1.0:1788448298.687376:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448298.687387:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826241152:0@lo:13: 00000100:00100000:1.0:1788448298.687420:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448298.687455:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241024 00000100:00100000:1.0:1788448298.687459:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241024 00000100:00100000:1.0:1788448298.687489:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241152 00000100:00100000:1.0:1788448298.687492:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241152 00000100:00100000:1.0:1788448298.687507:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448298.687514:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826241024:12345-0@lo:13: 00002000:00000024:1.0:1788448298.687533:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448298.687562:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826241024:12345-0@lo:13: Request processed in 49us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448298.687569:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448298.687589:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448298.687595:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826241152:12345-0@lo:13: 00002000:00000024:1.0:1788448298.687606:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448298.687636:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826241152:12345-0@lo:13: Request processed in 40us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448298.687642:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788448298.687659:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448298.687678:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc081a69c00 x1875323826241152/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448298.687693:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826241152:0@lo:13: 00000100:00100000:1.0:1788448298.688406:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826241536:0@lo:400: 00000100:00100000:1.0:1788448298.688442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448298.688482:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826241408:0@lo:400: 00000100:00100000:1.0:1788448298.688510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448298.688531:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826241920:0@lo:400: 00000100:00100000:1.0:1788448298.688548:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448298.688567:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788448298.688572:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826241280:0@lo:400: 00000100:00100000:1.0:1788448298.688595:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448298.688615:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826241792:0@lo:400: 00000100:00100000:1.0:1788448298.688631:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448298.688654:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241408 00000100:00100000:1.0:1788448298.688659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241408 00000100:00100000:1.0:1788448298.688684:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241920 00000100:00100000:1.0:1788448298.688687:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241920 00000100:00100000:1.0:1788448298.688704:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241792 00000100:00100000:1.0:1788448298.688714:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241792 00000100:00100000:1.0:1788448298.688729:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448298.688735:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826241408:12345-0@lo:400: 00000100:00100000:1.0:1788448298.688774:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826241408:12345-0@lo:400: Request processed in 39us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448298.688780:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448298.688792:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448298.688797:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826241920:12345-0@lo:400: 00000100:00100000:1.0:1788448298.688818:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826241920:12345-0@lo:400: Request processed in 22us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448298.688823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448298.688832:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448298.688837:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826241792:12345-0@lo:400: 00000100:00100000:1.0:1788448298.688872:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826241792:12345-0@lo:400: Request processed in 35us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448298.688878:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788448298.688922:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448298.688925:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788448298.688942:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191314700 x1875323826241792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448298.688954:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826241792:0@lo:400: 00010000:00080000:1.0:1788448298.688963:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4895880 x1875323826241408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448298.688971:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826241408:0@lo:400: 00010000:00080000:1.0:1788448298.688980:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191317480 x1875323826241920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448298.688999:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191317480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826241920:0@lo:400: 00000100:00100000:1.0:1788448298.689032:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241280 00000100:00100000:1.0:1788448298.689035:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241280 00000100:00100000:1.0:1788448298.689058:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788448298.689064:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3648:x1875323826241280:12345-0@lo:400: 00000100:00100000:1.0:1788448298.689105:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3648:x1875323826241280:12345-0@lo:400: Request processed in 41us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448298.689111:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788448298.689139:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826241280:0@lo:400: 00000100:00100000:3.0:1788448298.689214:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241536 00000100:00100000:3.0:1788448298.689219:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241536 00000100:00100000:3.0:1788448298.689248:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448298.689254:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826241536:12345-0@lo:400: 00000100:00100000:3.0:1788448298.689287:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826241536:12345-0@lo:400: Request processed in 34us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448298.689292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448298.690460:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826241664:0@lo:400: 00000100:00100000:1.0:1788448298.691624:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826241536:0@lo:400: 00000100:00100000:1.0:1788448298.691693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788448298.691743:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4894700 x1875323826241024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448298.691762:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826241024:0@lo:13: 00000100:00100000:0.0:1788448298.692233:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826241664 00000100:00100000:0.0:1788448298.692242:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826241664 00000100:00100000:0.0:1788448298.692284:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448298.692293:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826241664:12345-0@lo:400: 00000100:00100000:0.0:1788448298.692367:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826241664:12345-0@lo:400: Request processed in 75us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448298.692381:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788448298.692626:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191316d80 x1875323826241664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448298.692636:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826241664:0@lo:400: 00010000:00010000:1.0:1788448299.006044:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448300.032095:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448301.055142:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448301.758402:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826242048:0@lo:41: 00000100:00100000:2.0:1788448301.758484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448301.758538:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242048 00000100:00100000:0.0:1788448301.758547:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242048 00000100:00100000:0.0:1788448301.758601:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448301.758610:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826242048:12345-0@lo:41: 00000004:00000024:0.0:1788448301.758924:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1788448301.758985:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826242048:12345-0@lo:41: Request processed in 376us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448301.758993:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448301.759168:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826242048:0@lo:41: 00010000:00010000:3.0:1788448302.083078:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.102239:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448303.299856:0:9510:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788448303.299860:0:9510:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788448303.299862:0:9510:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788448303.300015:0:9510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc1bf749000 00000020:01000004:2.0:1788448303.300028:0:9510:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788448303.300042:0:9510:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788448303.300073:0:9510:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fc0823d0000) 00000020:00000080:2.0:1788448303.300090:0:9510:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448303.345207:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788448303.345336:0:9510:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788448303.377198:0:9510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788448303.377418:0:9510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788448303.377435:0:9510:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788448303.377447:0:9510:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45a9e4e6b803580 00000020:01000004:3.0:1788448303.377454:0:9510:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788448303.377477:0:9510:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788448303.377486:0:9510:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788448303.377491:0:9510:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788448303.377519:0:9510:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788448303.377523:0:9510:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788448303.406192:0:9510:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448303.406230:0:9510:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788448303.406234:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448303.406236:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448303.406240:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448303.406242:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448303.406243:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448303.406244:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448303.406246:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448303.406247:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448303.406248:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448303.406250:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448303.406251:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448303.406254:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788448303.406256:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448303.406257:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448303.406258:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448303.406259:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448303.406260:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448303.406261:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448303.406262:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448303.406263:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448303.406264:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448303.406265:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448303.406266:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448303.406298:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788448303.406318:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826242176:0@lo:253: 00000100:00100000:2.0:1788448303.406401:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.406453:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18540f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448303.406513:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242176 00000100:00100000:0.0:1788448303.406522:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242176 00000100:00100000:0.0:1788448303.406609:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788448303.406620:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:9510:x1875323826242176:12345-0@lo:253: 20000000:01000000:0.0:1788448303.406662:0:6509:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788448303.406666:0:6509:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788448303.406672:0:6509:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788448303.406675:0:6509:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788448303.406918:0:6509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448303.407091:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1788448303.407108:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788448303.407125:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1788448303.407131:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788448303.407145:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1788448303.407159:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1788448303.407252:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1788448303.407268:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1788448303.407270:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448303.407285:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1788448303.407291:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448303.407314:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1788448303.407320:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448303.407333:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1788448303.407340:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788448303.407352:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1788448303.407367:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1788448303.407435:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1788448303.407447:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1788448303.407448:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448303.407461:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1788448303.407467:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448303.407481:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1788448303.407486:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448303.407499:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1788448303.407504:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788448303.407517:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1788448303.407534:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1788448303.407937:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1788448303.407950:0:6509:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.121@tcp 20000000:01000000:0.0:1788448303.407952:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.121@tcp (null) (null) (null) 00000040:00080000:0.0:1788448303.407967:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1788448303.407973:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788448303.407987:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1788448303.407993:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.121@tcp (null) (null) 00000040:00080000:0.0:1788448303.408004:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1788448303.408009:0:6509:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788448303.408019:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1788448303.408031:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1788448303.408044:0:6509:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788448303.408057:0:6509:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788448303.408066:0:6509:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788448303.408108:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788448303.408111:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448303.408706:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448303.408731:0:9516:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448303.408746:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:2.0:1788448303.408961:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:2.0:1788448303.408983:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:2.0:1788448303.408998:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:2.0:1788448303.409009:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788448303.409011:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788448303.409463:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:2.0:1788448303.409483:0:9517:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:2.0:1788448303.409496:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:0.0:1788448303.409643:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:0.0:1788448303.409663:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:0.0:1788448303.409678:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:0.0:1788448303.409686:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788448303.409688:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788448303.410304:0:9518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788448303.410456:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788448303.410477:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788448303.410493:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:3.0:1788448303.410501:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788448303.410503:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448303.410857:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448303.410876:0:9519:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448303.411227:0:9519:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788448303.411416:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788448303.411439:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788448303.411454:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:0.0:1788448303.411473:0:6509:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788448303.411475:0:6509:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448303.411782:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448303.411808:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448303.411819:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788448303.412491:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788448303.412521:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1788448303.412536:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:0.0:1788448303.412554:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788448303.412572:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412589:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412597:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412604:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412610:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412617:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412637:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412645:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412652:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412690:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412705:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 21 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.412720:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242304:0@lo:104: 00000100:00100000:0.0:1788448303.412785:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448303.412877:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.412915:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 21 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.412932:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242432:0@lo:104: 00000100:00100000:0.0:1788448303.412956:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448303.413461:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.413471:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 21 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.413488:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242560:0@lo:104: 00000100:00100000:0.0:1788448303.413524:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.413561:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242304 00000100:00100000:1.0:1788448303.413567:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242304 00000100:00100000:1.0:1788448303.413595:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242432 00000100:00100000:1.0:1788448303.413598:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242432 00000100:00100000:1.0:1788448303.413619:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448303.413627:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6509:x1875323826242304:12345-0@lo:104: 00010000:00010000:1.0:1788448303.413637:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413686:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448303.413692:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6509:x1875323826242304:12345-0@lo:104: Request processed in 66us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.413698:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448303.413714:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448303.413720:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6509:x1875323826242432:12345-0@lo:104: 00010000:00010000:1.0:1788448303.413728:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413760:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788448303.413765:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6509:x1875323826242432:12345-0@lo:104: Request processed in 46us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.413771:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788448303.413787:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448303.413792:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413798:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152ec00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448303.413801:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413809:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448303.413826:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448303.413832:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448303.413863:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413871:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448303.413912:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413919:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc18152ec00/0xf45a9e4e6b80356b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803572 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413944:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448303.413947:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413952:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448303.413955:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.413962:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448303.413968:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448303.413974:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448303.413995:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414001:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448303.414016:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414022:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180031000/0xf45a9e4e6b803541 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803548 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414031:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.414053:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.414055:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448303.414067:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826242688:0@lo:103: 00000100:00100000:1.0:1788448303.414095:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.414130:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826242816:0@lo:103: 00000100:00100000:1.0:1788448303.414152:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.414181:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242688 00000100:00100000:1.0:1788448303.414185:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242688 00010000:00010000:1.0:1788448303.414202:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 22 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448303.414220:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242816 00000100:00100000:1.0:1788448303.414223:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242816 00010000:00010000:1.0:1788448303.414232:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 23 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448303.414244:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448303.414249:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3646:x1875323826242688:12345-0@lo:103: 00010000:00010000:1.0:1788448303.414258:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448303.414269:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 23 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414280:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 23 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414296:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448303.414324:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3646:x1875323826242688:12345-0@lo:103: Request processed in 75us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.414331:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448303.414344:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448303.414350:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3647:x1875323826242816:12345-0@lo:103: 00010000:00010000:1.0:1788448303.414358:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448303.414361:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 22 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414369:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 22 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.414377:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448303.414399:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3647:x1875323826242816:12345-0@lo:103: Request processed in 49us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.414405:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448303.414440:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826242816:0@lo:103: 00000100:00100000:1.0:1788448303.414463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826242688:0@lo:103: 00010000:00010000:3.0:1788448303.414636:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448303.414731:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.414742:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 21 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.414751:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242944:0@lo:104: 00000100:00100000:0.0:1788448303.414775:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448303.414794:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.414802:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 21 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.414810:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826243072:0@lo:104: 00000100:00100000:1.0:1788448303.415224:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242560 00000100:00100000:1.0:1788448303.415230:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242560 00000100:00100000:1.0:1788448303.415251:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826242944 00000100:00100000:1.0:1788448303.415254:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826242944 00000100:00100000:1.0:1788448303.415279:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448303.415285:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6509:x1875323826242560:12345-0@lo:104: 00010000:00010000:1.0:1788448303.415294:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.415349:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.415401:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243072 00000100:00100000:2.0:1788448303.415406:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243072 00010000:00010000:1.0:1788448303.415530:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448303.415536:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6509:x1875323826242560:12345-0@lo:104: Request processed in 251us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.415542:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448303.415557:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448303.415563:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6509:x1875323826242944:12345-0@lo:104: 00010000:00010000:1.0:1788448303.415570:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.415749:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.415759:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 21 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.415768:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826243200:0@lo:104: 00000100:00100000:0.0:1788448303.415797:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448303.415830:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.415850:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 21 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.415859:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826243328:0@lo:104: 00000100:00100000:0.0:1788448303.415899:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286a80 going to sleep for 11 seconds 00010000:00010000:0.0:1788448303.415917:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803572 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80356b expref: 21 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.415940:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242304:0@lo:104: 00010000:00010000:0.0:1788448303.415951:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180031e00/0xf45a9e4e6b803548 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803541 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.415959:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242432:0@lo:104: 00000100:00100000:0.0:1788448303.415967:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242560:0@lo:104: 00000100:00100000:0.0:1788448303.415973:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826242944:0@lo:104: 00000100:00100000:3.0:1788448303.416197:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788448303.416214:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.416223:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788448303.416227:0:6500:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788448303.416304:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448303.416331:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416338:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8e00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448303.416342:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416350:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448303.416356:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448303.416362:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448303.416427:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416434:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448303.416449:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416456:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a8e00/0xf45a9e4e6b803525 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80352c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416465:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448303.416469:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416475:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448303.416478:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.416495:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448303.416501:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448303.416507:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788448303.416650:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243200 00000100:00100000:0.0:1788448303.416655:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243200 00000100:00100000:0.0:1788448303.416679:0:6500:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788448303.416686:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243328 00000100:00100000:0.0:1788448303.416689:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243328 00000100:00100000:0.0:1788448303.416760:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448303.416768:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6509:x1875323826243072:12345-0@lo:104: 00010000:00010000:0.0:1788448303.416776:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.416832:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826243072:0@lo:104: 00010000:00010000:0.0:1788448303.416857:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448303.416864:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:6509:x1875323826243072:12345-0@lo:104: Request processed in 98us (1515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.416871:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788448303.416906:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788448303.416998:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448303.417006:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6509:x1875323826243200:12345-0@lo:104: 00010000:00010000:0.0:1788448303.417015:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.417080:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826243200:0@lo:104: 00010000:00010000:0.0:1788448303.417089:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448303.417093:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081aa8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:6509:x1875323826243200:12345-0@lo:104: Request processed in 89us (1297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.417098:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448303.417112:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448303.417118:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6509:x1875323826243328:12345-0@lo:104: 00010000:00010000:0.0:1788448303.417124:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.417162:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6509:1875323826243328:0@lo:104: 00010000:00010000:0.0:1788448303.417195:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.417209:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448303.417213:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6509:x1875323826243328:12345-0@lo:104: Request processed in 97us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.417226:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788448303.417439:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788448303.417446:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6509:x1875323826242944:12345-0@lo:104: Request processed in 1884us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.417453:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448303.417494:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826243456:0@lo:103: 00000100:00100000:1.0:1788448303.417525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.417654:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243456 00000100:00100000:0.0:1788448303.417659:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243456 00010000:00010000:0.0:1788448303.417677:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.417705:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448303.417712:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3648:x1875323826243456:12345-0@lo:103: 00010000:00010000:0.0:1788448303.417723:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448303.417728:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.417738:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.417752:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f400/0xf45a9e4e6b80352c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803525 expref: 20 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.417764:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448303.417792:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3648:x1875323826243456:12345-0@lo:103: Request processed in 81us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.417798:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448303.417874:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826243456:0@lo:103: 00010000:00010000:1.0:1788448303.418070:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448303.418159:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418167:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448303.418171:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418179:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448303.418200:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448303.418206:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448303.418238:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418245:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448303.418258:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418264:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8034df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034e6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418274:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448303.418278:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418283:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448303.418286:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418292:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448303.418297:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448303.418301:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448303.418322:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418328:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448303.418334:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418342:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b803476 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80347d expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.418350:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448303.418352:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448303.418353:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448303.418394:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826243584:0@lo:103: 00000100:00100000:1.0:1788448303.418426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.418460:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448303.418466:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826243712:0@lo:103: 00000100:00100000:1.0:1788448303.418498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.418531:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243584 00000100:00100000:1.0:1788448303.418536:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243584 00010000:00010000:1.0:1788448303.418553:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 19 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448303.418572:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243712 00000100:00100000:1.0:1788448303.418576:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243712 00010000:00010000:1.0:1788448303.418587:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 20 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448303.418599:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448303.418605:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3645:x1875323826243584:12345-0@lo:103: 00010000:00010000:1.0:1788448303.418613:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448303.418617:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 20 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.418626:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 20 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.418637:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b8034e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8034df expref: 20 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.418651:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448303.418677:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3645:x1875323826243584:12345-0@lo:103: Request processed in 73us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.418683:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448303.418718:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448303.418725:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3645:x1875323826243712:12345-0@lo:103: 00010000:00010000:1.0:1788448303.418732:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448303.418745:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 18 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.418752:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 18 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.418761:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80347d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803476 expref: 18 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.418771:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448303.418793:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:3645:x1875323826243712:12345-0@lo:103: Request processed in 69us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.418799:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448303.418824:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826243712:0@lo:103: 00000100:00100000:1.0:1788448303.418831:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826243584:0@lo:103: 00010000:00010000:1.0:1788448303.419371:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.419375:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.419377:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448303.419408:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419417:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448303.419421:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419440:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448303.419448:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448303.419454:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448303.419482:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419489:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448303.419509:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419516:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b8034a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034a7 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419527:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448303.419529:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448303.419531:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448303.419565:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826243840:0@lo:103: 00000100:00100000:3.0:1788448303.419601:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.419674:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243840 00000100:00100000:0.0:1788448303.419679:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243840 00010000:00010000:0.0:1788448303.419697:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 17 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.419754:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448303.419762:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:3647:x1875323826243840:12345-0@lo:103: 00010000:00010000:0.0:1788448303.419771:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448303.419775:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 17 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419790:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 17 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419800:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b8034a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8034a0 expref: 17 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.419810:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448303.419842:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3647:x1875323826243840:12345-0@lo:103: Request processed in 82us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.419849:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788448303.419990:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.419997:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448303.420005:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.420012:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e800/0xf45a9e4e6b8034fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803502 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.420026:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448303.420027:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448303.420029:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448303.420214:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826243968:0@lo:103: 00000100:00100000:1.0:1788448303.420243:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.420461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826243968 00000100:00100000:3.0:1788448303.420466:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826243968 00010000:00010000:3.0:1788448303.420486:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 16 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.420501:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788448303.420508:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3648:x1875323826243968:12345-0@lo:103: 00010000:00010000:3.0:1788448303.420516:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448303.420521:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 16 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420530:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 16 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420540:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180030e00/0xf45a9e4e6b803502 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8034fb expref: 16 pid: 6511 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420561:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420570:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420585:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420592:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420599:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420606:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420612:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448303.420616:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420623:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420644:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.420655:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448303.420683:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3648:x1875323826243968:12345-0@lo:103: Request processed in 176us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.420698:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788448303.420744:0:6509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.420752:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.420759:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b803587 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448303.420772:0:6509:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788448303.420824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826243968:0@lo:103: 00000100:00100000:0.0:1788448303.422566:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826243840:0@lo:103: 00000100:00100000:1.0:1788448303.423183:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:9510:x1875323826242176:12345-0@lo:253: Request processed in 16560us (16777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.423193:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788448303.423272:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826242176:0@lo:253: 10000000:01000000:2.0:1788448303.423287:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788448303.423290:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448303.423292:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448303.423293:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448303.423294:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788448303.423296:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448303.423297:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448303.423299:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448303.423300:0:9510:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788448303.423302:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448303.423314:0:9510:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448303.423333:0:9510:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc1bf749000 from lustre-OST0001 10000000:01000000:2.0:1788448303.423363:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788448303.423366:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788448303.423374:0:9510:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc19ebe99b8 local copy 10000000:01000000:2.0:1788448303.423379:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788448303.423410:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.423421:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.423430:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448303.423447:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244096:0@lo:101: 00000100:00100000:2.0:1788448303.423483:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.423546:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448303.423580:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244096 00000100:00100000:1.0:1788448303.423588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244096 00000100:00100000:1.0:1788448303.423659:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788448303.423669:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:9510:x1875323826244096:12345-0@lo:101: 00010000:00010000:1.0:1788448303.423683:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448303.423695:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b803595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80358e expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.423718:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b803595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80358e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.423728:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b803595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80358e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.423737:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9200, rc 0) 00000100:00100000:1.0:1788448303.423811:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244096:12345-0@lo:101: Request processed in 144us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.423817:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788448303.424222:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244096:0@lo:101: 00010000:00010000:2.0:1788448303.424237:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.424247:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448303.424338:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244224:0@lo:501: 00000100:00100000:2.0:1788448303.424367:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.424435:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448303.424532:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244224 00000100:00100000:1.0:1788448303.424538:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244224 00000100:00100000:1.0:1788448303.424570:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788448303.424577:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244224:12345-0@lo:501: 00000100:00100000:1.0:1788448303.424637:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244224:12345-0@lo:501: Request processed in 60us (270us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448303.424656:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788448303.424718:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244224:0@lo:501: 10000000:01000000:2.0:1788448303.424729:0:9510:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788448303.424750:0:9510:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788448303.424756:0:9510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.424763:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.424770:0:9510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.424793:0:9510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788448303.424821:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc1bf749000 10000000:01000000:2.0:1788448303.424826:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448303.424831:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788448303.424833:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448303.424837:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788448303.424840:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788448303.424856:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.424864:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.424871:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448303.424904:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244352:0@lo:101: 00000100:00100000:2.0:1788448303.424931:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.424943:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2480 going to sleep for 11 seconds 00010000:00010000:1.0:1788448303.424995:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448303.425002:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425009:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181680400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448303.425012:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425020:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448303.425027:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448303.425033:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448303.425062:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425068:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448303.425094:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425101:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b80358e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf45a9e4e6b803595 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425117:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.425119:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448303.425121:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448303.425128:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448303.425143:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826244480:0@lo:103: 00000100:00100000:1.0:1788448303.425170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.425197:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244480 00000100:00100000:1.0:1788448303.425201:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244480 00000100:00100000:1.0:1788448303.425229:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448303.425236:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3646:x1875323826244480:12345-0@lo:103: 00010000:00010000:1.0:1788448303.425244:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448303.425256:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b803595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80358e expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425270:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448303.425297:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:3646:x1875323826244480:12345-0@lo:103: Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.425303:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448303.425326:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826244480:0@lo:103: 00000100:00100000:1.0:1788448303.425344:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244352 00000100:00100000:1.0:1788448303.425347:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244352 00000100:00100000:1.0:1788448303.425365:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448303.425372:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+14:9510:x1875323826244352:12345-0@lo:101: 00010000:00010000:1.0:1788448303.425380:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448303.425391:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80359c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425408:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425417:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448303.425436:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9000, rc 0) 00000100:00100000:1.0:1788448303.425465:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244352:12345-0@lo:101: Request processed in 93us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.425471:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788448303.425547:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244352:0@lo:101: 00010000:00010000:2.0:1788448303.425564:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.425572:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448303.425631:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244608:0@lo:501: 00000100:00100000:2.0:1788448303.425654:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.425671:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448303.425707:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244608 00000100:00100000:1.0:1788448303.425710:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244608 00000100:00100000:1.0:1788448303.425766:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788448303.425773:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244608:12345-0@lo:501: 00000100:00100000:1.0:1788448303.425859:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244608:12345-0@lo:501: Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.425866:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788448303.426102:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244608:0@lo:501: 00000100:00100000:2.0:1788448303.426126:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244736:0@lo:503: 00000100:00100000:2.0:1788448303.426168:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.426196:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.426247:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244736 00000100:00100000:3.0:1788448303.426252:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244736 00000100:00100000:3.0:1788448303.426274:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788448303.426281:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244736:12345-0@lo:503: 00000100:00100000:3.0:1788448303.426371:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244736:12345-0@lo:503: Request processed in 90us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.426378:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788448303.426454:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244736:0@lo:503: 00000040:00080000:2.0:1788448303.426723:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448303.426789:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244864:0@lo:502: 00000100:00100000:2.0:1788448303.426822:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.426844:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.426927:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244864 00000100:00100000:3.0:1788448303.426931:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244864 00000100:00100000:3.0:1788448303.426950:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788448303.426956:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244864:12345-0@lo:502: 00000100:00100000:3.0:1788448303.427025:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244864:12345-0@lo:502: Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.427031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788448303.427116:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244864:0@lo:502: 00000040:00080000:2.0:1788448303.427302:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788448303.427328:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788448303.427344:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788448303.427357:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788448303.427369:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788448303.427380:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788448303.427399:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244992:0@lo:502: 00000100:00100000:2.0:1788448303.427442:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.427472:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.427523:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826244992 00000100:00100000:3.0:1788448303.427528:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826244992 00000100:00100000:3.0:1788448303.427547:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788448303.427554:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244992:12345-0@lo:502: 00000100:00100000:3.0:1788448303.427630:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826244992:12345-0@lo:502: Request processed in 74us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.427636:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788448303.427710:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826244992:0@lo:502: 00000040:00080000:2.0:1788448303.427746:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788448303.427753:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:2.0:1788448303.428189:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448303.428198:0:9524:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788448303.428204:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448303.428206:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788448303.428211:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448303.428227:0:9524:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fc0823d3370) 00000020:00000080:2.0:1788448303.428248:0:9524:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788448303.428254:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788448303.428330:0:9524:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bf749000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788448303.428338:0:9524:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448303.428344:0:9524:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45a9e4e6b8035b1 00010000:00010000:2.0:1788448303.432867:0:9524:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:2.0:1788448303.433280:0:9524:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788448303.435685:0:9524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788448303.436238:0:9524:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788448303.440522:0:9524:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788448303.440704:0:9524:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788448303.448774:0:9524:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788448303.450293:0:9524:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788448303.450308:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448303.450315:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448303.450318:0:9524:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788448303.450320:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448303.450324:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448303.450326:0:9524:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448303.450329:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448303.450331:0:9524:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788448303.450357:0:9524:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448303.450367:0:9524:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448303.450369:0:9524:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788448303.450372:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788448303.450552:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788448303.450584:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788448303.450655:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.450674:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448303.450683:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bf749000 from 1 10000000:01000000:3.0:1788448303.450686:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448303.450727:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.450737:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.450748:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.450771:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245120:0@lo:101: 00000100:00100000:3.0:1788448303.450840:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.450913:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448303.451023:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245120 00000100:00100000:2.0:1788448303.451031:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245120 00000100:00100000:2.0:1788448303.451104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788448303.451115:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:9510:x1875323826245120:12345-0@lo:101: 00010000:00010000:2.0:1788448303.451129:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448303.451143:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8035b8 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.451166:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.451176:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.451185:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681a00, rc 0) 00000100:00100000:2.0:1788448303.451224:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245120:12345-0@lo:101: Request processed in 112us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.451232:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788448303.451463:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245120:0@lo:101: 00010000:00010000:3.0:1788448303.451479:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.451488:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.451581:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245248:0@lo:501: 00000100:00100000:3.0:1788448303.451611:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.451641:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448303.451693:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245248 00000100:00100000:2.0:1788448303.451698:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245248 00000100:00100000:2.0:1788448303.451730:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788448303.451737:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245248:12345-0@lo:501: 00000100:00100000:2.0:1788448303.451840:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245248:12345-0@lo:501: Request processed in 102us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.451847:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788448303.451908:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245248:0@lo:501: 00000100:00100000:2.0:1788448303.452064:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245376:0@lo:503: 00000100:00100000:2.0:1788448303.452106:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.452135:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.452177:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245376 00000100:00100000:3.0:1788448303.452182:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245376 00000100:00100000:3.0:1788448303.452214:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788448303.452220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245376:12345-0@lo:503: 00000100:00100000:3.0:1788448303.452297:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245376:12345-0@lo:503: Request processed in 76us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.452304:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788448303.452371:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245376:0@lo:503: 00000040:00080000:2.0:1788448303.452575:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448303.452634:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245504:0@lo:502: 00000100:00100000:2.0:1788448303.452668:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.452691:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448303.452706:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245504 00000100:00100000:2.0:1788448303.452710:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245504 00000100:00100000:2.0:1788448303.452734:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448303.452740:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245504:12345-0@lo:502: 00000100:00100000:2.0:1788448303.452812:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245504:12345-0@lo:502: Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.452819:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448303.452853:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245504:0@lo:502: 00000040:00080000:2.0:1788448303.453185:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788448303.453209:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788448303.453227:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245632:0@lo:502: 00000100:00100000:2.0:1788448303.453260:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.453328:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.453439:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245632 00000100:00100000:3.0:1788448303.453445:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245632 00000100:00100000:3.0:1788448303.453516:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788448303.453524:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245632:12345-0@lo:502: 00000100:00100000:3.0:1788448303.453600:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245632:12345-0@lo:502: Request processed in 77us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.453607:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788448303.453673:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245632:0@lo:502: 00000040:00080000:2.0:1788448303.453710:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788448303.453718:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788448303.454220:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448303.454230:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448303.454238:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788448303.454244:0:9527:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1bf749000 00000020:00000080:2.0:1788448303.454247:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448303.454259:0:9527:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448303.454261:0:9527:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448303.454262:0:9527:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788448303.454264:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788448303.454374:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788448303.454424:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448303.454448:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.454460:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448303.454507:0:9510:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448303.454511:0:9510:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc1bf749000 10000000:01000000:3.0:1788448303.454514:0:9510:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc1bf749000 10000000:01000000:3.0:1788448303.454518:0:9510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448303.454523:0:9510:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1bf749000 from 1 10000000:01000000:3.0:1788448303.454526:0:9510:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448303.454555:0:9510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.454568:0:9510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.454578:0:9510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.454595:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245760:0@lo:101: 00000100:00100000:3.0:1788448303.454639:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.454669:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969773c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.454686:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245760 00000100:00100000:3.0:1788448303.454691:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245760 00000100:00100000:3.0:1788448303.454732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788448303.454740:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9510:x1875323826245760:12345-0@lo:101: 00010000:00010000:3.0:1788448303.454752:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448303.454763:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8035c6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.454784:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.454794:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.454802:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:3.0:1788448303.454833:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826245760:12345-0@lo:101: Request processed in 94us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.454839:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788448303.454908:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245760:0@lo:101: 00010000:00010000:3.0:1788448303.455063:0:9510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.455073:0:9510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.455148:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245888:0@lo:501: 00000100:00100000:3.0:1788448303.455173:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.455232:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448303.455512:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826245888 00000100:00100000:2.0:1788448303.455517:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826245888 00000100:00100000:2.0:1788448303.455553:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788448303.455560:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826245888:12345-0@lo:501: 00000100:00100000:2.0:1788448303.455660:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826245888:12345-0@lo:501: Request processed in 101us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.455667:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788448303.455701:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826245888:0@lo:501: 00000100:00100000:2.0:1788448303.455728:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826246016:0@lo:503: 00000100:00100000:2.0:1788448303.455767:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.455781:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420900 going to sleep for 11 seconds 00000100:00100000:2.0:1788448303.455794:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246016 00000100:00100000:2.0:1788448303.455798:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246016 00000100:00100000:2.0:1788448303.455814:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788448303.455820:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826246016:12345-0@lo:503: 00000100:00100000:2.0:1788448303.455914:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826246016:12345-0@lo:503: Request processed in 94us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.456038:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788448303.456089:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826246016:0@lo:503: 00000040:00080000:2.0:1788448303.456290:0:9510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448303.456345:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826246144:0@lo:502: 00000100:00100000:2.0:1788448303.456382:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.456440:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448303.456495:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246144 00000100:00100000:1.0:1788448303.456499:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246144 00000100:00100000:1.0:1788448303.456531:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788448303.456538:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826246144:12345-0@lo:502: 00000100:00100000:1.0:1788448303.456619:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826246144:12345-0@lo:502: Request processed in 81us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.456625:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788448303.456697:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826246144:0@lo:502: 00000040:00080000:2.0:1788448303.456852:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788448303.456908:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788448303.456996:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788448303.457016:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788448303.457029:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788448303.457040:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788448303.457065:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788448303.457079:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788448303.457094:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788448303.457108:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788448303.457122:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788448303.457134:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788448303.457148:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788448303.457162:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788448303.457175:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788448303.457201:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788448303.457216:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788448303.457230:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788448303.457242:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788448303.457253:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788448303.457265:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788448303.457276:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788448303.457288:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788448303.457302:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788448303.457314:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788448303.457326:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788448303.457338:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788448303.457351:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788448303.457375:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788448303.457387:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788448303.457398:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788448303.457427:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788448303.457442:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788448303.457455:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788448303.457474:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788448303.457489:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788448303.457502:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788448303.457514:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788448303.457527:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788448303.457539:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788448303.457552:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788448303.457563:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788448303.457577:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788448303.457589:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788448303.457600:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788448303.457610:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788448303.457635:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826246272:0@lo:502: 00000100:00100000:2.0:1788448303.457679:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.457714:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448303.458020:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246272 00000100:00100000:1.0:1788448303.458027:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246272 00000100:00100000:1.0:1788448303.458073:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788448303.458081:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826246272:12345-0@lo:502: 00000100:00100000:1.0:1788448303.458176:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826246272:12345-0@lo:502: Request processed in 96us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.458183:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788448303.459745:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826246272:0@lo:502: 00000040:00080000:0.0:1788448303.459847:0:9510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788448303.459861:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788448303.460463:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788448303.460477:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fc1bb5399b8) 00000020:00000080:0.0:1788448303.460511:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788448303.460592:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bf749000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788448303.460596:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bf749000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788448303.460599:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bf749000 3 00010000:00080000:0.0:1788448303.460629:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc0831cf000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448303.469459:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788448303.469708:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788448303.469755:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448303.469767:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf45a9e4e6b8035db 00000100:00080000:0.0:1788448303.469778:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448303.469784:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc0831cf000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448303.469828:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf783480 x1875323826246400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448303.469855:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788448303.470063:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826246400:0@lo:38: 00000100:00100000:1.0:1788448303.470157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.470173:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826246912:0@lo:400: 00000100:00100000:2.0:1788448303.470216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.470216:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246400 00000100:00100000:1.0:1788448303.470223:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246400 00000100:00100000:2.0:1788448303.470238:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826247424:0@lo:400: 00000100:00100000:1.0:1788448303.470256:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448303.470263:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.470263:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826246400:12345-0@lo:38: 00000100:00100000:2.0:1788448303.470280:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00010000:00080000:1.0:1788448303.470283:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1788448303.470325:0:6517:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf45a9e4e6b8035e2 00000004:00100000:1.0:1788448303.470340:0:6517:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788448303.470369:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448303.470416:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875323826246400:12345-0@lo:38: Request processed in 152us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.470423:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788448303.470468:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf783480 x1875323826246400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448303.470476:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448303.470483:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788448303.470489:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788448303.470492:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788448303.470494:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788448303.470499:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826246400:0@lo:38: 00000100:00100000:2.0:1788448303.471043:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826246528:0@lo:400: 00000100:00100000:2.0:1788448303.471086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.471106:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826247040:0@lo:400: 00000100:00100000:2.0:1788448303.471140:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.471173:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826246656:0@lo:400: 00000100:00100000:2.0:1788448303.471198:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.471216:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826247168:0@lo:400: 00000100:00100000:2.0:1788448303.471240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.471258:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788448303.471265:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826246784:0@lo:400: 00000100:00100000:2.0:1788448303.471300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.471317:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826247296:0@lo:400: 00000100:00100000:2.0:1788448303.471337:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.471364:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246912 00000100:00100000:2.0:1788448303.471369:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246912 00000100:00100000:2.0:1788448303.471399:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246656 00000100:00100000:2.0:1788448303.471402:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246656 00000100:00100000:2.0:1788448303.471417:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448303.471424:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826246912:12345-0@lo:400: 00000100:00100000:2.0:1788448303.471468:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826246912:12345-0@lo:400: Request processed in 45us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.471475:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448303.471489:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448303.471495:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826246656:12345-0@lo:400: 00000100:00100000:2.0:1788448303.471526:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826246656:12345-0@lo:400: Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.471532:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448303.471550:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247424 00000100:00100000:2.0:1788448303.471554:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247424 00000100:00100000:2.0:1788448303.471586:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247296 00000100:00100000:2.0:1788448303.471596:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247296 00000100:00100000:2.0:1788448303.471620:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448303.471627:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826247424:12345-0@lo:400: 00000100:00100000:2.0:1788448303.471657:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826247424:12345-0@lo:400: Request processed in 31us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.471662:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448303.471674:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448303.471679:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826247296:12345-0@lo:400: 00000100:00100000:2.0:1788448303.471704:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826247296:12345-0@lo:400: Request processed in 25us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.471710:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448303.471727:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246528 00000100:00100000:2.0:1788448303.471731:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246528 00000100:00100000:2.0:1788448303.471747:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247040 00000100:00100000:2.0:1788448303.471750:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247040 00000100:00100000:2.0:1788448303.471761:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247168 00000100:00100000:2.0:1788448303.471763:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247168 00000100:00100000:2.0:1788448303.471775:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826246784 00000100:00100000:2.0:1788448303.471777:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826246784 00000100:00100000:2.0:1788448303.471789:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448303.471794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826246528:12345-0@lo:400: 00000100:00100000:2.0:1788448303.471822:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826246528:12345-0@lo:400: Request processed in 27us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.471822:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448303.471828:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448303.471829:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826247040:12345-0@lo:400: 00000100:00100000:2.0:1788448303.471838:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448303.471843:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826247168:12345-0@lo:400: 00000100:00100000:1.0:1788448303.471859:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826247040:12345-0@lo:400: Request processed in 31us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448303.471864:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826247168:12345-0@lo:400: Request processed in 23us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.471865:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448303.471903:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448303.471916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448303.471917:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826246784:12345-0@lo:400: 00000100:00100000:1.0:1788448303.471946:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826246784:12345-0@lo:400: Request processed in 30us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.471951:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1788448303.472076:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424000 x1875323826246784/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.472100:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826246784:0@lo:400: 00010000:00080000:0.0:1788448303.472115:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424a80 x1875323826247296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.472123:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826247296:0@lo:400: 00000100:00100000:0.0:1788448303.472132:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826246656:0@lo:400: 00010000:00080000:0.0:1788448303.472142:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424e00 x1875323826247168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.472150:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826247168:0@lo:400: 00010000:00080000:0.0:1788448303.472188:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb426a00 x1875323826246528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.472195:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826246528:0@lo:400: 00010000:00080000:0.0:1788448303.472204:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb424700 x1875323826247040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.472212:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826247040:0@lo:400: 00000100:00100000:0.0:1788448303.472222:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826246912:0@lo:400: 00010000:00080000:0.0:1788448303.472231:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb427480 x1875323826247424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.472250:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826247424:0@lo:400: 00000100:00080000:2.0:1788448303.473211:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448303.473220:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448303.473223:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000004:0.0:1788448303.475570:0:9529:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788448303.475588:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fc1bb53cd28) 00000100:00100000:2.0:1788448303.475613:0:9530:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1875323826247552:0@lo:901: 00000020:00000080:0.0:1788448303.475613:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000100:00100000:2.0:1788448303.475679:0:9530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.475708:0:9530:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448303.475759:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247552 00000100:00100000:1.0:1788448303.475767:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247552 00000100:00100000:1.0:1788448303.475825:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448303.475835:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1875323826247552:12345-0@lo:901: 00000100:00100000:1.0:1788448303.475955:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9530:x1875323826247552:12345-0@lo:901: Request processed in 121us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.475964:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788448303.476023:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788448303.476061:0:9530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bb426300 x1875323826247552/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788448319 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:01000004:0.0:1788448303.476067:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bf749000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788448303.476071:0:9529:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bf749000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788448303.476073:0:9529:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bf749000 3 00000100:00100000:2.0:1788448303.476074:0:9530:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9530:1875323826247552:0@lo:901: 00010000:00080000:0.0:1788448303.476101:0:9529:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc0831ce000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448303.482418:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1788448303.482606:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788448303.482657:0:9529:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788448303.482673:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf45a9e4e6b8035f0 00000100:00080000:1.0:1788448303.482685:0:9529:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448303.482691:0:9529:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc0831ce000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448303.482729:0:9529:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1c11cce00 x1875323826247680/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448303.482759:0:9529:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788448303.483184:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826247680:0@lo:38: 00000100:00100000:2.0:1788448303.483264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448303.483781:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247680 00000100:00100000:1.0:1788448303.483790:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247680 00000100:00100000:1.0:1788448303.483839:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448303.483848:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826247680:12345-0@lo:38: 00010000:00080000:1.0:1788448303.483876:0:6519:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1788448303.483938:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf45a9e4e6b8035f7 00000004:00100000:1.0:1788448303.483954:0:6519:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788448303.483998:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448303.484078:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875323826247680:12345-0@lo:38: Request processed in 229us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448303.484085:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788448303.484142:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1c11cce00 x1875323826247680/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448313 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448303.484154:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448303.484161:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788448303.484168:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448303.484172:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788448303.484174:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448303.484180:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826247680:0@lo:38: 00000040:00080000:1.0:1788448303.484629:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788448303.484917:0:9510:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788448303.484975:0:9510:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448303.485001:0:9510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448303.485027:0:9510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788448303.485237:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788448303.485240:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448303.485242:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448303.485243:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448303.485244:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448303.485246:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448303.485247:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448303.485249:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448303.485251:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448303.485252:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448303.485253:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448303.485257:0:9510:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788448303.485259:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448303.485260:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448303.485261:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448303.485262:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448303.485263:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448303.485264:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448303.485266:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448303.485267:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448303.485268:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448303.485269:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448303.485270:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448303.485297:0:9510:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788448303.485312:0:9510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826247808:0@lo:253: 00000100:00100000:2.0:1788448303.485366:0:9510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448303.485406:0:9510:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448303.485578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247808 00000100:00100000:3.0:1788448303.485585:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247808 00000100:00100000:3.0:1788448303.485638:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788448303.485647:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826247808:12345-0@lo:253: 20000000:01000000:3.0:1788448303.485681:0:6511:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788448303.485694:0:6511:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788448303.501149:0:6511:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788448303.501172:0:6511:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788448303.501369:0:6533:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788448303.501374:0:6533:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788448303.501396:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.501415:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.501423:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.501431:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.501472:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.501486:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 17 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.501500:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826247936:0@lo:104: 00000100:00100000:0.0:1788448303.501576:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448303.501634:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.501643:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 17 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448303.501652:0:6533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826248064:0@lo:104: 00000100:00100000:0.0:1788448303.501674:0:6533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.501692:0:6533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1a1566900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448303.501712:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826247936 00000100:00100000:0.0:1788448303.501727:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826247936 00000100:00100000:0.0:1788448303.501775:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248064 00000100:00100000:0.0:1788448303.501778:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248064 00000100:00100000:0.0:1788448303.501794:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448303.501804:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826247936:12345-0@lo:104: 00010000:00010000:0.0:1788448303.501816:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.502032:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448303.502041:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826248064:12345-0@lo:104: 00010000:00010000:3.0:1788448303.502060:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.502109:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448303.502115:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:6533:x1875323826248064:12345-0@lo:104: Request processed in 76us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.502123:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448303.502188:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9510:x1875323826247808:12345-0@lo:253: Request processed in 16543us (16821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.502209:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:0.0:1788448303.502380:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448303.502387:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:6533:x1875323826247936:12345-0@lo:104: Request processed in 584us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.502394:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:0.0:1788448303.502412:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448303.502418:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502425:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448303.502430:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502444:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448303.502451:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448303.502457:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448303.502489:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502496:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448303.502513:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502520:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180031800/0xf45a9e4e6b8034ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8034f4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502533:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448303.502536:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502542:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448303.502545:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502551:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448303.502557:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448303.502568:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448303.502582:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502588:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448303.502602:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502609:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180031400/0xf45a9e4e6b803533 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80353a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.502621:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448303.502623:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448303.502624:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448303.502636:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826248192:0@lo:103: 00000100:00100000:0.0:1788448303.502665:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.502698:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826248320:0@lo:103: 00000100:00100000:0.0:1788448303.502817:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.502967:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826247936:0@lo:104: 00000100:00100000:0.0:1788448303.502979:0:6533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6533:1875323826248064:0@lo:104: 00010000:00010000:0.0:1788448303.503002:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.503073:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248192 00000100:00100000:3.0:1788448303.503078:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248192 00010000:00010000:3.0:1788448303.503100:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 17 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.503126:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248320 00000100:00100000:3.0:1788448303.503130:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248320 00010000:00010000:3.0:1788448303.503142:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 18 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.503155:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788448303.503162:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3646:x1875323826248192:12345-0@lo:103: 00010000:00010000:3.0:1788448303.503174:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448303.503178:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 18 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.503188:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 18 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.503201:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681800/0xf45a9e4e6b8034f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8034ed expref: 18 pid: 6509 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.503215:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448303.503246:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:3646:x1875323826248192:12345-0@lo:103: Request processed in 85us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.503253:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788448303.503267:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448303.503274:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3647:x1875323826248320:12345-0@lo:103: 00000100:00100000:0.0:1788448303.503386:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826248192:0@lo:103: 00000100:00100000:2.0:1788448303.503535:0:9510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9510:1875323826247808:0@lo:253: 10000000:01000000:2.0:1788448303.503546:0:9510:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788448303.503550:0:9510:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448303.503551:0:9510:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448303.503559:0:9510:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448303.503560:0:9510:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448303.503562:0:9510:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448303.503563:0:9510:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448303.503565:0:9510:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448303.503566:0:9510:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448303.503568:0:9510:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448303.503569:0:9510:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448303.503571:0:9510:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788448303.503591:0:9510:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788448303.504993:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448303.505008:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 16 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505026:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 16 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505056:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180031600/0xf45a9e4e6b80353a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803533 expref: 16 pid: 6510 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505073:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505082:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788448303.505101:0:6502:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009023884s 00010000:00010000:3.0:1788448303.505106:0:6502:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505113:0:6502:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505120:0:6502:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505126:0:6502:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505132:0:6502:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152fa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448303.505136:0:6502:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505157:0:6502:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505186:0:6502:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448303.505198:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448303.505276:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3647:x1875323826248320:12345-0@lo:103: Request processed in 2001us (2457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.505514:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826248320:0@lo:103: 00010000:00010000:0.0:1788448303.505547:0:6533:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.505561:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448303.505567:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b8035fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448303.506038:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788448303.510499:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788448303.513585:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:2.0:1788448303.513899:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1788448303.514211:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1788448303.514514:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1788448303.514790:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788448303.515173:0:9510:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1788448303.516876:0:9510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788448303.530956:0:9510:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788448303.530967:0:9510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788448303.531030:0:9510:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788448303.531158:0:9510:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788448303.531179:0:9510:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788448303.531208:0:9510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788448303.537315:0:9510:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448303.537522:0:9510:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788448303.806240:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826248448:0@lo:13: 00000100:00100000:0.0:1788448303.806307:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.806390:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826248576:0@lo:41: 00000100:00100000:0.0:1788448303.806422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448303.806451:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448303.806458:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826248704:0@lo:13: 00000100:00100000:0.0:1788448303.806498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448303.806511:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248576 00000100:00100000:3.0:1788448303.806520:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248576 00000100:00100000:0.0:1788448303.806543:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248448 00000100:00100000:0.0:1788448303.806548:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248448 00000100:00100000:3.0:1788448303.806572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788448303.806575:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248704 00000100:00100000:0.0:1788448303.806579:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248704 00000100:00100000:3.0:1788448303.806585:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826248576:12345-0@lo:41: 00000100:00100000:0.0:1788448303.806596:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448303.806603:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826248448:12345-0@lo:13: 00000004:00000024:3.0:1788448303.806618:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00002000:00000024:0.0:1788448303.806627:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448303.806675:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826248448:12345-0@lo:13: Request processed in 72us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448303.806690:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826248576:12345-0@lo:41: Request processed in 108us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.806691:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448303.806702:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788448303.806727:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448303.806736:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826248704:12345-0@lo:13: 00002000:00000024:0.0:1788448303.806746:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448303.806772:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826248704:12345-0@lo:13: Request processed in 37us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448303.806777:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788448303.806812:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf783100 x1875323826248704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.806830:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826248704:0@lo:13: 00000100:00100000:0.0:1788448303.806843:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826248576:0@lo:41: 00010000:00080000:0.0:1788448303.806871:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc191315880 x1875323826248448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448303.806916:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826248448:0@lo:13: 00010000:00010000:2.0:1788448304.126173:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788448304.480411:0:9585:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448304.482197:0:9585:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448305.150844:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448306.177757:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448306.878285:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448306.878320:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826248832:0@lo:41: 00000100:00100000:2.0:1788448306.878414:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448306.878522:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248832 00000100:00100000:3.0:1788448306.878532:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248832 00000100:00100000:3.0:1788448306.878609:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448306.878622:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826248832:12345-0@lo:41: 00000004:00000024:3.0:1788448306.878668:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788448306.878742:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826248832:12345-0@lo:41: Request processed in 123us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448306.878749:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448306.878856:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826248832:0@lo:41: 00010000:00010000:1.0:1788448307.198039:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448308.230098:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448308.926123:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826249472:0@lo:400: 00000100:00100000:2.0:1788448308.926272:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826248960:0@lo:41: 00000100:00100000:0.0:1788448308.926291:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.926971:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927090:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826249344:0@lo:13: 00000100:00100000:2.0:1788448308.927125:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927164:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826249984:0@lo:400: 00000100:00100000:2.0:1788448308.927194:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927224:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826250496:0@lo:400: 00000100:00100000:2.0:1788448308.927247:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927274:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788448308.927279:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826249856:0@lo:400: 00000100:00100000:2.0:1788448308.927301:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927318:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826250368:0@lo:400: 00000100:00100000:2.0:1788448308.927338:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927375:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826249088:0@lo:400: 00000100:00100000:2.0:1788448308.927406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927431:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826249600:0@lo:400: 00000100:00100000:2.0:1788448308.927452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927463:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826250112:0@lo:400: 00000100:00100000:2.0:1788448308.927483:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927501:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826250624:0@lo:13: 00000100:00100000:2.0:1788448308.927524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927545:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788448308.927552:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826249216:0@lo:400: 00000100:00100000:2.0:1788448308.927574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.927585:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826249728:0@lo:400: 00000100:00100000:2.0:1788448308.927605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.928011:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826250240:0@lo:400: 00000100:00100000:2.0:1788448308.928052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448308.928098:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249344 00000100:00100000:2.0:1788448308.928108:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249344 00000100:00100000:2.0:1788448308.928177:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250624 00000100:00100000:2.0:1788448308.928181:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250624 00000100:00100000:2.0:1788448308.928218:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448308.928228:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826249344:12345-0@lo:13: 00002000:00000024:2.0:1788448308.928277:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448308.928332:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826249344:12345-0@lo:13: Request processed in 106us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928340:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448308.928357:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448308.928363:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826250624:12345-0@lo:13: 00002000:00000024:2.0:1788448308.928372:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448308.928408:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826250624:12345-0@lo:13: Request processed in 45us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928415:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448308.928441:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249984 00000100:00100000:2.0:1788448308.928445:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249984 00000100:00100000:2.0:1788448308.928470:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250496 00000100:00100000:2.0:1788448308.928474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250496 00000100:00100000:2.0:1788448308.928487:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249856 00000100:00100000:2.0:1788448308.928490:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249856 00000100:00100000:2.0:1788448308.928502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250368 00000100:00100000:2.0:1788448308.928506:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250368 00000100:00100000:2.0:1788448308.928519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249600 00000100:00100000:2.0:1788448308.928521:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249600 00000100:00100000:2.0:1788448308.928534:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249216 00000100:00100000:2.0:1788448308.928536:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249216 00000100:00100000:2.0:1788448308.928553:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448308.928559:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826249984:12345-0@lo:400: 00000100:00100000:2.0:1788448308.928607:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826249984:12345-0@lo:400: Request processed in 48us (1412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928614:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448308.928635:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448308.928641:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826250496:12345-0@lo:400: 00000100:00100000:2.0:1788448308.928690:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826250496:12345-0@lo:400: Request processed in 50us (1442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448308.928709:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448308.928716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826249856:12345-0@lo:400: 00000100:00100000:2.0:1788448308.928745:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826249856:12345-0@lo:400: Request processed in 30us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928750:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448308.928857:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448308.928870:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826250368:12345-0@lo:400: 00000100:00100000:2.0:1788448308.928925:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826250368:12345-0@lo:400: Request processed in 61us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928931:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448308.928949:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448308.928955:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826249600:12345-0@lo:400: 00000100:00100000:2.0:1788448308.928983:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826249600:12345-0@lo:400: Request processed in 28us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.928988:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448308.928999:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448308.929005:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826249216:12345-0@lo:400: 00000100:00100000:2.0:1788448308.929043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826249216:12345-0@lo:400: Request processed in 39us (1468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.929048:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448308.929085:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250112 00000100:00100000:2.0:1788448308.929096:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250112 00000100:00100000:2.0:1788448308.929124:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250240 00000100:00100000:2.0:1788448308.929127:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250240 00000100:00100000:2.0:1788448308.929144:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448308.929151:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826250112:12345-0@lo:400: 00000100:00100000:2.0:1788448308.929179:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826250112:12345-0@lo:400: Request processed in 30us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.929185:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448308.929196:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448308.929202:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826250240:12345-0@lo:400: 00000100:00100000:2.0:1788448308.929226:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826250240:12345-0@lo:400: Request processed in 25us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448308.929231:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788448308.929254:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448308.929259:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448308.929262:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448308.929336:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb426a00 x1875323826249216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929352:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826249216:0@lo:400: 00010000:00080000:2.0:1788448308.929365:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341ad80 x1875323826250240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929374:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826250240:0@lo:400: 00010000:00080000:2.0:1788448308.929385:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb425c00 x1875323826249600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929393:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826249600:0@lo:400: 00010000:00080000:2.0:1788448308.929402:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341b480 x1875323826250112/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929419:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826250112:0@lo:400: 00010000:00080000:2.0:1788448308.929432:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc191316d80 x1875323826250624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929447:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826250624:0@lo:13: 00010000:00080000:2.0:1788448308.929492:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424000 x1875323826249856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929503:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826249856:0@lo:400: 00010000:00080000:2.0:1788448308.929515:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341a680 x1875323826250368/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929523:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826250368:0@lo:400: 00010000:00080000:2.0:1788448308.929532:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf783800 x1875323826249344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929543:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826249344:0@lo:13: 00010000:00080000:2.0:1788448308.929554:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083418a80 x1875323826249984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929561:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826249984:0@lo:400: 00010000:00080000:2.0:1788448308.929571:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341b100 x1875323826250496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448308.929578:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826250496:0@lo:400: 00000100:00100000:3.0:1788448308.930714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249472 00000100:00100000:3.0:1788448308.930734:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249472 00000100:00100000:3.0:1788448308.931070:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826248960 00000100:00100000:3.0:1788448308.931075:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826248960 00000100:00100000:3.0:1788448308.931092:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249728 00000100:00100000:3.0:1788448308.931095:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249728 00000100:00100000:3.0:1788448308.931113:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448308.931122:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826249472:12345-0@lo:400: 00000100:00100000:3.0:1788448308.931226:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826249472:12345-0@lo:400: Request processed in 104us (4937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448308.931233:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448308.931252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788448308.931258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826248960:12345-0@lo:41: 00000004:00000024:3.0:1788448308.931286:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788448308.931327:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3648:x1875323826248960:12345-0@lo:41: Request processed in 69us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448308.931333:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788448308.931346:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448308.931352:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826249728:12345-0@lo:400: 00000100:00100000:3.0:1788448308.931389:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826249728:12345-0@lo:400: Request processed in 37us (3783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448308.931395:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448308.931420:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826249088 00000100:00100000:3.0:1788448308.931424:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826249088 00000100:00100000:3.0:1788448308.931454:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788448308.931460:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3645:x1875323826249088:12345-0@lo:400: 00000100:00100000:3.0:1788448308.931493:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3645:x1875323826249088:12345-0@lo:400: Request processed in 34us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448308.931498:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788448308.931572:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826249472:0@lo:400: 00000100:00100000:3.0:1788448308.931610:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826249728:0@lo:400: 00000100:00100000:3.0:1788448308.931621:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826249088:0@lo:400: 00000100:00100000:3.0:1788448308.931663:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826248960:0@lo:41: 00010000:00010000:1.0:1788448309.246477:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448310.270389:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448310.348526:0:9875:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:3.0:1788448310.973993:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788448310.974015:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1ba23b000 from 39 10000000:01000000:3.0:1788448310.974021:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448310.974067:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448310.974079:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448310.974090:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448310.974114:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826250752:0@lo:101: 00000100:00100000:3.0:1788448310.974182:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448310.974254:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448310.974388:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250752 00000100:00100000:0.0:1788448310.974396:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250752 00000100:00100000:0.0:1788448310.974454:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788448310.974655:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826250752:12345-0@lo:101: 00010000:00010000:0.0:1788448310.974670:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448310.974684:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803605 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448310.974722:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448310.974733:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448310.974743:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f400, rc 0) 00000100:00100000:0.0:1788448310.974796:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826250752:12345-0@lo:101: Request processed in 333us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448310.974803:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448310.974924:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826250752:0@lo:101: 00010000:00010000:2.0:1788448310.974952:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448310.974970:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448310.975182:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826250880:0@lo:501: 00000100:00100000:2.0:1788448310.975211:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448310.975245:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448310.975456:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826250880 00000100:00100000:3.0:1788448310.975462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826250880 00000100:00100000:3.0:1788448310.975498:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788448310.975507:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826250880:12345-0@lo:501: 00000100:00100000:3.0:1788448310.975679:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826250880:12345-0@lo:501: Request processed in 172us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448310.975686:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788448310.979785:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826250880:0@lo:501: 00000100:00100000:2.0:1788448310.979857:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251008:0@lo:503: 00000100:00100000:2.0:1788448310.979965:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448310.980021:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448310.980288:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251008 00000100:00100000:0.0:1788448310.980301:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251008 00000100:00100000:0.0:1788448310.980359:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788448310.980369:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826251008:12345-0@lo:503: 00000100:00100000:0.0:1788448310.980513:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826251008:12345-0@lo:503: Request processed in 145us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448310.980521:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788448310.980713:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251008:0@lo:503: 00000100:00100000:0.0:1788448310.981681:0:9897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9897:1875323826251136:0@lo:502: 00000100:00100000:0.0:1788448310.981738:0:9897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448310.981780:0:9897:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448310.981792:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251136 00000100:00100000:3.0:1788448310.981799:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251136 00000100:00100000:3.0:1788448310.981853:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788448310.981862:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9897:x1875323826251136:12345-0@lo:502: 00000100:00100000:3.0:1788448310.982432:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9897:x1875323826251136:12345-0@lo:502: Request processed in 569us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448310.982440:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788448310.982575:0:9897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9897:1875323826251136:0@lo:502: 00000100:00100000:0.0:1788448310.982703:0:9897:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9897:1875323826251264:0@lo:502: 00000100:00100000:0.0:1788448310.982739:0:9897:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448310.983039:0:9897:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448310.983555:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251264 00000100:00100000:3.0:1788448310.983561:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251264 00000100:00100000:3.0:1788448310.983617:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788448310.983626:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9897:x1875323826251264:12345-0@lo:502: 00000100:00100000:3.0:1788448310.983740:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:9897:x1875323826251264:12345-0@lo:502: Request processed in 114us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448310.983747:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788448310.984505:0:9897:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9897:1875323826251264:0@lo:502: 00000040:00080000:0.0:1788448310.984553:0:9897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788448310.984779:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788448310.984818:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448310.984829:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448310.984840:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448310.984848:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788448310.984851:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788448310.984854:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448310.985196:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448310.985206:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448310.985225:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448310.985246:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251392:0@lo:101: 00000100:00100000:2.0:1788448310.985296:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448310.985327:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448310.985670:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251392 00000100:00100000:0.0:1788448310.985677:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251392 00000100:00100000:0.0:1788448310.985729:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788448310.985738:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826251392:12345-0@lo:101: 00010000:00010000:0.0:1788448310.985749:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448310.985761:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803613 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448310.985783:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448310.985793:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448310.985802:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f600, rc 0) 00000100:00100000:0.0:1788448310.985857:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826251392:12345-0@lo:101: Request processed in 121us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448310.985864:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788448310.986432:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251392:0@lo:101: 00010000:00010000:2.0:1788448310.986450:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448310.986462:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448310.986529:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251520:0@lo:501: 00000100:00100000:2.0:1788448310.986563:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448310.986600:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448310.986659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251520 00000100:00100000:1.0:1788448310.986665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251520 00000100:00100000:1.0:1788448310.986700:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788448310.986708:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826251520:12345-0@lo:501: 00000100:00100000:1.0:1788448310.986840:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826251520:12345-0@lo:501: Request processed in 132us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448310.986847:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788448310.987347:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251520:0@lo:501: 00000100:00100000:2.0:1788448310.987380:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251648:0@lo:503: 00000100:00100000:2.0:1788448310.987430:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448310.987449:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448310.988230:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251648 00000100:00100000:1.0:1788448310.988238:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251648 00000100:00100000:1.0:1788448310.988296:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788448310.988305:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826251648:12345-0@lo:503: 00000100:00100000:1.0:1788448310.991173:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826251648:12345-0@lo:503: Request processed in 2860us (3733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448310.991187:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788448310.991322:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826251648:0@lo:503: 00000100:00100000:1.0:1788448310.994288:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9898:1875323826251776:0@lo:502: 00000100:00100000:1.0:1788448310.994384:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448310.994545:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251776 00000100:00100000:1.0:1788448310.994549:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448310.994552:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251776 00000100:00100000:3.0:1788448310.994606:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788448310.994616:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9898:x1875323826251776:12345-0@lo:502: 00000100:00100000:3.0:1788448310.994734:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9898:x1875323826251776:12345-0@lo:502: Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448310.994741:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788448310.994845:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9898:1875323826251776:0@lo:502: 00000020:01000000:1.0:1788448310.994914:0:9898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448310.994924:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448310.994926:0:9898:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448310.994934:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448310.994936:0:9898:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788448310.994951:0:9898:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9898:1875323826251904:0@lo:502: 00000100:00100000:1.0:1788448310.994982:0:9898:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448310.995016:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826251904 00000100:00100000:1.0:1788448310.995020:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826251904 00000100:00100000:1.0:1788448310.995043:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788448310.995049:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9898:x1875323826251904:12345-0@lo:502: 00000100:00100000:1.0:1788448310.995113:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:9898:x1875323826251904:12345-0@lo:502: Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448310.995119:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788448310.995148:0:9898:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448310.995159:0:9898:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9898:1875323826251904:0@lo:502: 00000020:01000000:1.0:1788448310.995175:0:9898:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448310.995179:0:9898:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448310.995180:0:9898:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788448310.995184:0:9898:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788448310.995373:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788448310.995402:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788448310.995412:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448310.995435:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448310.995445:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788448310.995447:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc19ea22000 from 39 10000000:01000000:3.0:1788448310.995451:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448310.995473:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448310.995481:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448310.995490:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448310.995501:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252032:0@lo:101: 00000100:00100000:3.0:1788448310.995529:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448310.995551:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292180 going to sleep for 11 seconds 00000100:00100000:1.0:1788448310.995777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252032 00000100:00100000:1.0:1788448310.995782:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252032 00000100:00100000:1.0:1788448310.995826:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788448310.995834:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826252032:12345-0@lo:101: 00010000:00010000:1.0:1788448310.995842:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448310.995853:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803621 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448310.995873:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448310.995919:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448310.995928:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8200, rc 0) 00000100:00100000:1.0:1788448310.995960:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826252032:12345-0@lo:101: Request processed in 128us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448310.995966:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788448310.996015:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191315880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252032:0@lo:101: 00010000:00010000:1.0:1788448310.996028:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448310.996037:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448310.996079:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252160:0@lo:501: 00000100:00100000:1.0:1788448310.996104:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448310.996118:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448310.996129:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252160 00000100:00100000:1.0:1788448310.996132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252160 00000100:00100000:1.0:1788448310.996153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788448310.996160:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826252160:12345-0@lo:501: 00000100:00100000:1.0:1788448310.996259:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826252160:12345-0@lo:501: Request processed in 99us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448310.996267:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788448310.996299:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252160:0@lo:501: 00000100:00100000:1.0:1788448310.996324:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252288:0@lo:503: 00000100:00100000:1.0:1788448310.996563:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448310.996595:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448310.996640:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252288 00000100:00100000:3.0:1788448310.996644:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252288 00000100:00100000:3.0:1788448310.996676:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788448310.996683:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826252288:12345-0@lo:503: 00000100:00100000:3.0:1788448310.996750:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826252288:12345-0@lo:503: Request processed in 68us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448310.996757:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788448310.996950:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252288:0@lo:503: 00000100:00100000:3.0:1788448311.004487:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9899:1875323826252416:0@lo:502: 00000100:00100000:3.0:1788448311.004571:0:9899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.004625:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292180 going to sleep for 11 seconds 00000100:00100000:1.0:1788448311.004685:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252416 00000100:00100000:1.0:1788448311.004693:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252416 00000100:00100000:1.0:1788448311.004744:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788448311.004753:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:9899:x1875323826252416:12345-0@lo:502: 00000100:00100000:1.0:1788448311.004918:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:9899:x1875323826252416:12345-0@lo:502: Request processed in 165us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.004926:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788448311.005091:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9899:1875323826252416:0@lo:502: 00000100:00100000:2.0:1788448311.005139:0:9899:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9899:1875323826252544:0@lo:502: 00000100:00100000:2.0:1788448311.005177:0:9899:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.005204:0:9899:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.005295:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252544 00000100:00100000:3.0:1788448311.005301:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252544 00000100:00100000:3.0:1788448311.005407:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448311.005416:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:9899:x1875323826252544:12345-0@lo:502: 00000100:00100000:3.0:1788448311.005496:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:9899:x1875323826252544:12345-0@lo:502: Request processed in 81us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.005503:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788448311.006098:0:9899:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9899:1875323826252544:0@lo:502: 00000040:00080000:2.0:1788448311.006130:0:9899:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788448311.010771:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788448311.010835:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448311.010848:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.010861:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448311.010874:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448311.010877:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc19ea22000 from 6 10000000:01000000:0.0:1788448311.010912:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448311.010951:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.010959:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.010970:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448311.010993:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252672:0@lo:101: 00000100:00100000:0.0:1788448311.011068:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.011110:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.011135:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252672 00000100:00100000:0.0:1788448311.011142:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252672 00000100:00100000:0.0:1788448311.011187:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788448311.011196:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826252672:12345-0@lo:101: 00010000:00010000:0.0:1788448311.011207:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448311.011220:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80362f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.011241:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80362f expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.011251:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80362f expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.011260:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152fa00, rc 0) 00000100:00100000:0.0:1788448311.011296:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826252672:12345-0@lo:101: Request processed in 100us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.011311:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788448311.011502:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252672:0@lo:101: 00010000:00010000:0.0:1788448311.011517:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.011525:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448311.011570:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252800:0@lo:256: 00000100:00100000:0.0:1788448311.011601:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.011616:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.011628:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252800 00000100:00100000:0.0:1788448311.011631:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252800 00000100:00100000:0.0:1788448311.011650:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788448311.011657:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826252800:12345-0@lo:256: 20000000:01000000:0.0:1788448311.011669:0:6509:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448311.011685:0:6509:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448311.011688:0:6509:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788448311.011765:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826252800:12345-0@lo:256: Request processed in 108us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.011772:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788448311.011801:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252800:0@lo:256: 10000000:01000000:0.0:1788448311.013589:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448311.013602:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.013613:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448311.013630:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788448311.013633:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788448311.013636:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788448311.013664:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.013671:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.013681:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448311.013700:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252928:0@lo:101: 00000100:00100000:0.0:1788448311.013752:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.013788:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.016574:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826252928 00000100:00100000:0.0:1788448311.016593:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826252928 00000100:00100000:0.0:1788448311.016670:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788448311.016680:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826252928:12345-0@lo:101: 00010000:00010000:0.0:1788448311.016697:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448311.016714:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80363d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.016741:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.016752:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.016775:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152ec00, rc 0) 00000100:00100000:0.0:1788448311.018094:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826252928:12345-0@lo:101: Request processed in 1408us (4334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.018104:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788448311.023589:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826252928:0@lo:101: 00010000:00010000:2.0:1788448311.023617:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.023631:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448311.023707:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826253056:0@lo:501: 00000100:00100000:2.0:1788448311.023760:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.025084:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.025681:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253056 00000100:00100000:3.0:1788448311.025690:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253056 00000100:00100000:1.0:1788448311.025828:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448311.025838:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826253056:12345-0@lo:501: 00000100:00100000:1.0:1788448311.026001:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826253056:12345-0@lo:501: Request processed in 164us (2239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.026018:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788448311.026098:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826253056:0@lo:501: 00000100:00100000:2.0:1788448311.026136:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826253184:0@lo:503: 00000100:00100000:2.0:1788448311.026182:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.026551:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cbb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.026614:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253184 00000100:00100000:0.0:1788448311.026619:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253184 00000100:00100000:0.0:1788448311.026643:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788448311.026649:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826253184:12345-0@lo:503: 00000100:00100000:0.0:1788448311.026773:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826253184:12345-0@lo:503: Request processed in 122us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.026780:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788448311.027087:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826253184:0@lo:503: 00000100:00100000:1.0:1788448311.029602:0:9901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9901:1875323826253312:0@lo:502: 00000100:00100000:1.0:1788448311.029670:0:9901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.029752:0:9901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.033525:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253312 00000100:00100000:0.0:1788448311.033541:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253312 00000100:00100000:1.0:1788448311.033700:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788448311.033721:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:9901:x1875323826253312:12345-0@lo:502: 00000100:00100000:1.0:1788448311.034142:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:9901:x1875323826253312:12345-0@lo:502: Request processed in 432us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.034151:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788448311.034273:0:9901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9901:1875323826253312:0@lo:502: 00000020:01000000:0.0:1788448311.034311:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788448311.034319:0:9901:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788448311.034325:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.034328:0:9901:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788448311.034334:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788448311.034338:0:9901:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:0.0:1788448311.034371:0:9901:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788448311.034375:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448311.034388:0:9901:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fc1bb538000) 00000020:00000080:0.0:1788448311.034411:0:9901:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788448311.034417:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788448311.034507:0:9901:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788448311.034514:0:9901:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788448311.034528:0:9901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b803652 00010000:00080000:0.0:1788448311.034560:0:9901:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc0831cd000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448311.035270:0:9901:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788448311.035413:0:9901:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788448311.035424:0:9901:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788448311.035590:0:9901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448311.035700:0:9901:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448311.036154:0:9901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788448311.036241:0:9901:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788448311.037313:0:9903:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448311.037319:0:9903:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788448311.038214:0:9901:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448311.038227:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788448311.038267:0:9901:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788448311.038291:0:9901:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b803659 00000100:00080000:0.0:1788448311.038300:0:9901:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448311.038306:0:9901:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc0831cd000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448311.038343:0:9901:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf781f80 x1875323826253440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448311.038401:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826253440:0@lo:8: 00000100:00100000:2.0:1788448311.038480:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.038562:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253440 00000100:00100000:1.0:1788448311.038570:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253440 00000100:00100000:1.0:1788448311.038605:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448311.038618:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826253440:12345-0@lo:8: 00010000:00080000:1.0:1788448311.038642:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1788448311.038671:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b803660 00002000:00100000:1.0:1788448311.038685:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fc1bb4c5800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788448311.038688:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1788448311.038692:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788448311.038762:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788448311.039071:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788448311.039095:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448311.039533:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826253440:12345-0@lo:8: Request processed in 912us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.039541:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788448311.039551:0:9901:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788448311.039625:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448311.039630:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.039632:0:9901:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788448311.039635:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448311.039639:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.039640:0:9901:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448311.039643:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448311.039645:0:9901:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788448311.039672:0:9901:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9901:1875323826253568:0@lo:502: 00000100:00100000:0.0:1788448311.039720:0:9901:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.039744:0:9901:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0320000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.039781:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448311.039791:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826253696:0@lo:400: 00000100:00100000:3.0:1788448311.039834:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788448311.039839:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf781f80 x1875323826253440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.039849:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448311.039857:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788448311.039864:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:3.0:1788448311.039870:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826253824:0@lo:400: 00000100:00080000:2.0:1788448311.039955:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788448311.039959:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788448311.039967:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788448311.039974:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826253440:0@lo:8: 00000004:00080000:2.0:1788448311.039999:0:9903:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788448311.040035:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.040069:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253568 00000100:00100000:3.0:1788448311.040075:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253568 00000100:00100000:3.0:1788448311.040111:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788448311.040119:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:9901:x1875323826253568:12345-0@lo:502: 00000004:00080000:2.0:1788448311.040153:0:9903:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 228385270239ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788448311.040159:0:9903:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788448311.040221:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:9901:x1875323826253568:12345-0@lo:502: Request processed in 103us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.040228:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788448311.040262:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253824 00000100:00100000:3.0:1788448311.040265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253824 00000100:00100000:3.0:1788448311.040287:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448311.040293:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826253824:12345-0@lo:400: 00000100:00100000:3.0:1788448311.040332:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826253824:12345-0@lo:400: Request processed in 39us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.040349:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448311.040377:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826253824:0@lo:400: 00000100:00100000:3.0:1788448311.040414:0:9904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826253952:0@lo:700: 00000100:00100000:3.0:1788448311.040450:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.040477:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253952 00000100:00100000:3.0:1788448311.040481:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253952 00000100:00100000:3.0:1788448311.040514:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448311.040521:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9904:x1875323826253952:12345-0@lo:700: 00000100:00100000:3.0:1788448311.040547:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1875323826254080:0@lo:700: 00000100:00100000:3.0:1788448311.040575:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.040593:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.040605:0:9904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292180 going to sleep for 11 seconds 00000100:00080000:2.0:1788448311.040686:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448311.040852:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826254464:0@lo:400: 00000100:00100000:2.0:1788448311.040971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826254592:0@lo:400: 00000100:00100000:0.0:1788448311.041084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826253696 00000100:00100000:0.0:1788448311.041095:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826253696 00000100:00100000:2.0:1788448311.041141:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.041170:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254080 00000100:00100000:1.0:1788448311.041175:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254080 00000100:00100000:1.0:1788448311.041209:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448311.041216:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1875323826254080:12345-0@lo:700: 00000100:00100000:1.0:1788448311.041303:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826254336:0@lo:400: 00000100:00100000:3.0:1788448311.041355:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826254208:0@lo:400: 00000100:00100000:1.0:1788448311.041498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.041524:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826254848:0@lo:400: 00000100:00100000:1.0:1788448311.041542:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788448311.041567:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448311.041579:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254848 00000100:00100000:1.0:1788448311.041581:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254848 00000100:00100000:1.0:1788448311.041608:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448311.041613:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826254848:12345-0@lo:400: 00000100:00100000:1.0:1788448311.041651:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826254848:12345-0@lo:400: Request processed in 38us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.041657:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788448311.041669:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448311.041687:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f4380 x1875323826254848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448311.041698:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826254848:0@lo:400: 00000100:00100000:3.0:1788448311.041735:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254336 00000100:00100000:3.0:1788448311.041739:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254336 00000100:00100000:3.0:1788448311.041758:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448311.041764:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826254336:12345-0@lo:400: 00000100:00100000:3.0:1788448311.041806:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826254336:12345-0@lo:400: Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.041814:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826254336:0@lo:400: 00000100:00100000:3.0:1788448311.041823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788448311.042131:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254592 00000100:00100000:0.0:1788448311.042135:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254592 00000100:00100000:2.0:1788448311.042162:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448311.042174:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826253696:12345-0@lo:400: 00000100:00100000:2.0:1788448311.042213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826253696:12345-0@lo:400: Request processed in 41us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.042220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448311.042235:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448311.042242:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826254592:12345-0@lo:400: 00000100:00100000:2.0:1788448311.042286:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826254592:12345-0@lo:400: Request processed in 44us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.042292:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448311.042305:0:9901:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9901:1875323826253568:0@lo:502: 00000020:01000000:0.0:1788448311.042338:0:9901:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448311.042345:0:9901:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.042348:0:9901:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788448311.042352:0:9901:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00080000:1.0:1788448311.042487:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788448311.042500:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f7100 x1875323826254592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448311.042510:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826254592:0@lo:400: 00000100:00100000:2.0:1788448311.042599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.042660:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826254976:0@lo:400: 00000100:00100000:2.0:1788448311.042687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788448311.042850:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cce00 x1875323826253696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.042860:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826253696:0@lo:400: 00000020:01000000:2.0:1788448311.042986:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788448311.043029:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788448311.043040:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.043051:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448311.043061:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788448311.043063:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc190ac6000 from 39 10000000:01000000:2.0:1788448311.043067:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448311.043094:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.043103:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.043112:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448311.043126:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255104:0@lo:101: 00000100:00100000:2.0:1788448311.043155:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.043181:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255104 00000100:00100000:2.0:1788448311.043184:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448311.043186:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255104 00000100:00100000:2.0:1788448311.043209:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.043216:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788448311.043223:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826255104:12345-0@lo:101: 00010000:00010000:1.0:1788448311.043232:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448311.043245:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803667 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448311.043264:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448311.043273:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448311.043281:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8000, rc 0) 00000100:00100000:1.0:1788448311.043314:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826255104:12345-0@lo:101: Request processed in 91us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.043319:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788448311.043360:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255104:0@lo:101: 00010000:00010000:1.0:1788448311.043372:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448311.043381:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448311.043501:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255232:0@lo:501: 00000100:00100000:1.0:1788448311.043526:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.043540:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448311.043551:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255232 00000100:00100000:1.0:1788448311.043554:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255232 00000100:00100000:1.0:1788448311.043573:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788448311.043577:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826255232:12345-0@lo:501: 00000100:00100000:1.0:1788448311.043667:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826255232:12345-0@lo:501: Request processed in 89us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.043673:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788448311.043697:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255232:0@lo:501: 00000100:00100000:3.0:1788448311.043740:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254464 00000100:00100000:3.0:1788448311.043744:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254464 00000100:00100000:1.0:1788448311.043750:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255360:0@lo:503: 00000100:00100000:3.0:1788448311.043783:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254976 00000100:00100000:1.0:1788448311.043783:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.043786:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254976 00000100:00100000:1.0:1788448311.043795:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548900 going to sleep for 11 seconds 00000100:00080000:1.0:1788448311.043805:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448311.043808:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448311.043814:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255360 00000100:00100000:3.0:1788448311.043817:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448311.043817:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255360 00000100:00100000:3.0:1788448311.043824:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826254464:12345-0@lo:400: 00000100:00100000:1.0:1788448311.043835:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788448311.043840:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826255360:12345-0@lo:503: 00000100:00100000:3.0:1788448311.043864:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826254464:12345-0@lo:400: Request processed in 40us (1264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.043869:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448311.044086:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826255360:12345-0@lo:503: Request processed in 243us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.044093:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788448311.044107:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448311.044114:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826254976:12345-0@lo:400: 00000100:00100000:1.0:1788448311.044128:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255360:0@lo:503: 00000100:00100000:3.0:1788448311.044145:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826254976:12345-0@lo:400: Request processed in 32us (1458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.044151:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448311.044351:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254208 00000100:00100000:2.0:1788448311.044356:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254208 00000100:00100000:2.0:1788448311.044376:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448311.044382:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826254208:12345-0@lo:400: 00000100:00100000:2.0:1788448311.044414:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826254208:12345-0@lo:400: Request processed in 32us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.044427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788448311.044458:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f3480 x1875323826254464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.044471:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826254464:0@lo:400: 00010000:00080000:2.0:1788448311.044482:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f6300 x1875323826254976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.044491:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826254976:0@lo:400: 00010000:00080000:2.0:1788448311.044520:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f1f80 x1875323826254208/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.044529:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826254208:0@lo:400: 00000100:00100000:2.0:1788448311.044537:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826254720:0@lo:400: 00000100:00100000:2.0:1788448311.044565:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.044603:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826254720 00000100:00100000:2.0:1788448311.044607:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826254720 00000100:00100000:2.0:1788448311.044637:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448311.044644:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826254720:12345-0@lo:400: 00000100:00100000:2.0:1788448311.044681:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826254720:12345-0@lo:400: Request processed in 37us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.044687:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788448311.045105:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448311.045281:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f5880 x1875323826254720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.045292:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826254720:0@lo:400: 00000004:00080000:2.0:1788448311.045644:0:7448:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788448311.046413:0:9906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9906:1875323826255488:0@lo:502: 00000100:00100000:2.0:1788448311.046479:0:9906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.046523:0:9906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.046566:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255488 00000100:00100000:3.0:1788448311.046572:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255488 00000100:00100000:3.0:1788448311.046614:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788448311.046623:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:9906:x1875323826255488:12345-0@lo:502: 00000100:00100000:3.0:1788448311.046743:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:9906:x1875323826255488:12345-0@lo:502: Request processed in 121us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.046751:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788448311.047054:0:9906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9906:1875323826255488:0@lo:502: 00000100:00100000:2.0:1788448311.047099:0:9906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9906:1875323826255616:0@lo:502: 00000100:00100000:2.0:1788448311.047133:0:9906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.047163:0:9906:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.047543:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255616 00000100:00100000:3.0:1788448311.047548:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255616 00000100:00100000:3.0:1788448311.047578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788448311.047585:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:9906:x1875323826255616:12345-0@lo:502: 00000100:00100000:3.0:1788448311.047668:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:9906:x1875323826255616:12345-0@lo:502: Request processed in 83us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.047675:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788448311.048620:0:9906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9906:1875323826255616:0@lo:502: 00000040:00080000:2.0:1788448311.048649:0:9906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788448311.049127:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788448311.049180:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448311.049190:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.049201:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448311.049210:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788448311.049213:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc190ac6000 from 6 10000000:01000000:3.0:1788448311.049216:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448311.049244:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.049252:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.049260:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448311.049276:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255744:0@lo:101: 00000100:00100000:3.0:1788448311.049325:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.049362:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860240 going to sleep for 11 seconds 40000000:02000000:0.0:1788448311.049491:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1788448311.052629:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255744 00000100:00100000:2.0:1788448311.052643:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255744 00000100:00100000:2.0:1788448311.052708:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788448311.052720:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826255744:12345-0@lo:101: 00010000:00010000:2.0:1788448311.052735:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448311.052753:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80367c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803675 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.052779:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803675 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.052788:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80367c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803675 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.052797:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681600, rc 0) 00000100:00100000:2.0:1788448311.052993:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826255744:12345-0@lo:101: Request processed in 274us (3666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.052999:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788448311.053072:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255744:0@lo:101: 00010000:00010000:2.0:1788448311.053091:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053101:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448311.053162:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255872:0@lo:256: 00000100:00100000:2.0:1788448311.053200:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.053227:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.053242:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826255872 00000100:00100000:2.0:1788448311.053245:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826255872 00000100:00100000:2.0:1788448311.053269:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788448311.053276:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826255872:12345-0@lo:256: 20000000:01000000:2.0:1788448311.053290:0:6511:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448311.053305:0:6511:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448311.053307:0:6511:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788448311.053420:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826255872:12345-0@lo:256: Request processed in 143us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.053427:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788448311.053457:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826255872:0@lo:256: 10000000:01000000:2.0:1788448311.053501:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448311.053508:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053515:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448311.053532:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788448311.053534:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788448311.053537:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448311.053554:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053561:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053568:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448311.053579:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256000:0@lo:101: 00000100:00100000:2.0:1788448311.053602:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.053621:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.053631:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256000 00000100:00100000:2.0:1788448311.053635:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256000 00000100:00100000:2.0:1788448311.053655:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788448311.053661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826256000:12345-0@lo:101: 00010000:00010000:2.0:1788448311.053669:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448311.053677:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803683 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053691:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053699:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053798:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681400, rc 0) 00000100:00100000:2.0:1788448311.053921:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826256000:12345-0@lo:101: Request processed in 259us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.053928:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788448311.053960:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256000:0@lo:101: 00010000:00010000:2.0:1788448311.053972:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448311.053980:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448311.054048:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256128:0@lo:501: 00000100:00100000:2.0:1788448311.054072:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.054086:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b48e8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.054098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256128 00000100:00100000:2.0:1788448311.054101:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256128 00000100:00100000:2.0:1788448311.054122:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788448311.054129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826256128:12345-0@lo:501: 00000100:00100000:2.0:1788448311.054239:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826256128:12345-0@lo:501: Request processed in 110us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.054245:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788448311.054277:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256128:0@lo:501: 00000100:00100000:2.0:1788448311.054302:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256256:0@lo:503: 00000100:00100000:2.0:1788448311.054340:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.054352:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969e8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.054369:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256256 00000100:00100000:2.0:1788448311.054372:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256256 00000100:00100000:2.0:1788448311.054392:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788448311.054399:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826256256:12345-0@lo:503: 00000100:00100000:2.0:1788448311.054471:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826256256:12345-0@lo:503: Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.054478:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788448311.054516:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256256:0@lo:503: 00000100:00100000:1.0:1788448311.057001:0:9907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9907:1875323826256384:0@lo:502: 00000100:00100000:1.0:1788448311.057090:0:9907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.057170:0:9907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.060835:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0001:lustre-MDT0000-lwp-OST0001_UUID+5:8441:x1875323826254080:12345-0@lo:700: Request processed in 19610us (20249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.060849:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448311.061796:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256384 00000100:00100000:3.0:1788448311.062478:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256384 00000100:00100000:3.0:1788448311.062536:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788448311.062546:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:9907:x1875323826256384:12345-0@lo:502: 00000100:00100000:3.0:1788448311.062773:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:9907:x1875323826256384:12345-0@lo:502: Request processed in 228us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.062781:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00080000:2.0:1788448311.065875:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341d500 x1875323826254080/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.066078:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8441:1875323826254080:0@lo:700: 40000000:02000000:2.0:1788448311.066097:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:1.0:1788448311.067032:0:9907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9907:1875323826256384:0@lo:502: 00000020:01000000:1.0:1788448311.067072:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448311.067079:0:9907:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788448311.067089:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448311.067092:0:9907:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788448311.067097:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788448311.067101:0:9907:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:1.0:1788448311.067126:0:9907:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788448311.067129:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448311.067145:0:9907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fc1bb7999b8) 00000020:00000080:1.0:1788448311.067171:0:9907:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:1.0:1788448311.067178:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788448311.067282:0:9907:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788448311.067288:0:9907:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788448311.067295:0:9907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b803698 00010000:00080000:1.0:1788448311.067324:0:9907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc083576000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448311.067577:0:9907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:1.0:1788448311.067730:0:9907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788448311.067744:0:9907:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788448311.070025:0:9907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448311.070169:0:9907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448311.070283:0:9907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788448311.070368:0:9907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788448311.072244:0:9909:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448311.072251:0:9909:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000001:00100000:3.0:1788448311.080040:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788448311.080201:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9904:x1875323826253952:12345-0@lo:700: Request processed in 39675us (39745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.080214:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788448311.080303:0:9904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc191316d80 x1875323826253952/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448311.080318:0:9904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191316d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826253952:0@lo:700: 00000020:00000080:0.0:1788448311.081194:0:9907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788448311.081208:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788448311.081253:0:9907:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788448311.081277:0:9907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b80369f 00000100:00080000:0.0:1788448311.081285:0:9907:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448311.081290:0:9907:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc083576000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448311.081319:0:9907:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf782d80 x1875323826256512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448311.081341:0:9907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788448311.081394:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448311.081398:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.081400:0:9907:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788448311.081403:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448311.081406:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.081414:0:9907:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448311.081418:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448311.081420:0:9907:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788448311.081445:0:9907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9907:1875323826256640:0@lo:502: 00000100:00100000:0.0:1788448311.081507:0:9907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.081535:0:9907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.081621:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256640 00000100:00100000:3.0:1788448311.081628:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256640 00000100:00100000:3.0:1788448311.081668:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788448311.081678:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:9907:x1875323826256640:12345-0@lo:502: 00000100:00100000:3.0:1788448311.081790:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:9907:x1875323826256640:12345-0@lo:502: Request processed in 112us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.081798:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788448311.082032:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826256512:0@lo:8: 00000100:00100000:2.0:1788448311.082070:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.082265:0:9907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:9907:1875323826256640:0@lo:502: 00000020:01000000:0.0:1788448311.082290:0:9907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448311.082294:0:9907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448311.082296:0:9907:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788448311.082300:0:9907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1788448311.082535:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256512 00000100:00100000:1.0:1788448311.082540:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256512 00000100:00100000:1.0:1788448311.082566:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448311.082571:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875323826256512:12345-0@lo:8: 00010000:00080000:1.0:1788448311.082597:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:1.0:1788448311.082627:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b8036a6 00002000:00100000:1.0:1788448311.082639:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fc0835a9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788448311.082643:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788448311.082646:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788448311.082731:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788448311.082752:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fc0835af800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448311.082800:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826256512:12345-0@lo:8: Request processed in 228us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.082806:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788448311.082853:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf782d80 x1875323826256512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448311.082861:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448311.082867:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788448311.082874:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788448311.082878:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788448311.083046:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083576000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788448311.083058:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788448311.083063:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826256512:0@lo:8: 00000004:00080000:1.0:1788448311.083102:0:9909:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448311.083148:0:9909:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 228428265414ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448311.083154:0:9909:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788448311.087083:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000020:01000000:3.0:1788448311.087175:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788448311.087213:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788448311.087225:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087237:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448311.087248:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788448311.087251:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc19ebe99b8 from 1 10000000:01000000:3.0:1788448311.087254:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788448311.087288:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087296:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087308:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448311.087344:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256768:0@lo:101: 00000100:00100000:3.0:1788448311.087406:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.087441:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.087461:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256768 00000100:00100000:3.0:1788448311.087467:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256768 00000100:00100000:3.0:1788448311.087506:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788448311.087515:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826256768:12345-0@lo:101: 00010000:00010000:3.0:1788448311.087527:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448311.087539:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8036ad expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087574:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087584:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087593:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448311.087630:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826256768:12345-0@lo:101: Request processed in 115us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.087637:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788448311.087683:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256768:0@lo:101: 00010000:00010000:3.0:1788448311.087696:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448311.087720:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448311.087787:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256896:0@lo:501: 00000100:00100000:3.0:1788448311.087827:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.087843:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.089836:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826256896 00000100:00100000:0.0:1788448311.089849:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826256896 00000100:00100000:0.0:1788448311.089918:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788448311.089929:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826256896:12345-0@lo:501: 00000100:00100000:0.0:1788448311.090063:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826256896:12345-0@lo:501: Request processed in 135us (2234us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448311.090070:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788448311.090122:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826256896:0@lo:501: 10000000:01000000:0.0:1788448311.090160:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788448311.090169:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448311.090179:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448311.098457:0:9910:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788448311.098489:0:9910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826257152:0@lo:7: 00000100:00100000:3.0:1788448311.098557:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.098585:0:9910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.098646:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826257024:0@lo:13: 00000100:00100000:2.0:1788448311.098681:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.098730:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257152 00000100:00100000:2.0:1788448311.098736:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257152 00000100:00100000:2.0:1788448311.098790:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448311.098799:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9910:x1875323826257152:12345-0@lo:7: 00000100:00100000:3.0:1788448311.098919:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257024 00000100:00100000:3.0:1788448311.098924:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257024 00000100:00100000:3.0:1788448311.098953:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448311.098960:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826257024:12345-0@lo:13: 00002000:00000024:3.0:1788448311.100998:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:3.0:1788448311.101095:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826257024:12345-0@lo:13: Request processed in 2133us (2410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.101104:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788448311.106329:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341dc00 x1875323826257024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448311.106361:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826257024:0@lo:13: 00000100:00080000:0.0:1788448311.106401:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788448311.113090:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788448311.113099:0:8434:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788448311.113192:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9910:x1875323826257152:12345-0@lo:7: Request processed in 14389us (14630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.113202:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448311.113372:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448311.113388:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826257280:0@lo:13: 00000100:00100000:0.0:1788448311.113430:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788448311.113477:0:9904:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788448311.113500:0:9904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826257408:0@lo:7: 00000100:00100000:0.0:1788448311.113525:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.113548:0:9904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448311.115860:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257280 00000100:00100000:3.0:1788448311.115874:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257280 00000100:00100000:3.0:1788448311.115954:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448311.115965:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826257280:12345-0@lo:13: 00002000:00000024:3.0:1788448311.115989:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923918848 avail 3692396544 00000100:00100000:3.0:1788448311.116075:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826257280:12345-0@lo:13: Request processed in 112us (2644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.116083:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788448311.116133:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf782680 x1875323826257280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448311.116168:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826257280:0@lo:13: 00000100:00100000:0.0:1788448311.116737:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257408 00000100:00100000:0.0:1788448311.116743:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257408 00000100:00100000:0.0:1788448311.116783:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448311.116792:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9904:x1875323826257408:12345-0@lo:7: 00010000:00080000:2.0:1788448311.122872:0:9910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341c000 x1875323826257152/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.122923:0:9910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826257152:0@lo:7: 00000004:00080000:2.0:1788448311.122938:0:9910:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788448311.122975:0:9910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826257536:0@lo:5: 00000100:00100000:2.0:1788448311.124087:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.124137:0:9910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.126029:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257536 00000100:00100000:2.0:1788448311.126039:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257536 00000100:00100000:2.0:1788448311.126091:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448311.126102:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9910:x1875323826257536:12345-0@lo:5: 00002000:00080000:2.0:1788448311.126129:0:8539:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788448311.126133:0:8539:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00002000:00080000:0.0:1788448311.129421:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788448311.129429:0:8433:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788448311.129571:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9904:x1875323826257408:12345-0@lo:7: Request processed in 12775us (16040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448311.129582:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788448311.134857:0:9904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf781f80 x1875323826257408/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448311.134875:0:9904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826257408:0@lo:7: 00000004:00080000:3.0:1788448311.134910:0:9904:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788448311.134952:0:9904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826257664:0@lo:5: 00000100:00100000:3.0:1788448311.135139:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.135177:0:9904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860240 going to sleep for 11 seconds 00000100:00100000:1.0:1788448311.135258:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257664 00000100:00100000:1.0:1788448311.135265:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257664 00000100:00100000:1.0:1788448311.135315:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448311.135324:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9904:x1875323826257664:12345-0@lo:5: 00002000:00080000:1.0:1788448311.135348:0:8431:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788448311.135391:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9904:x1875323826257664:12345-0@lo:5: Request processed in 68us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.135399:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000001:00080000:2.0:1788448311.141450:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788448311.141468:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788448311.141589:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9910:x1875323826257536:12345-0@lo:5: Request processed in 15484us (17500us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788448311.141598:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788448311.141652:0:9910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424a80 x1875323826257536/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448311.141662:0:9910:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788448311.141669:0:9910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826257536:0@lo:5: 00000004:00080000:2.0:1788448311.141682:0:9910:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788448311.141810:0:9910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826257792:0@lo:700: 00000100:00100000:2.0:1788448311.141844:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.141877:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257792 00000100:00100000:2.0:1788448311.141974:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257792 00010000:00080000:1.0:1788448311.142198:0:9904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341c700 x1875323826257664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448311.142210:0:9904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826257664:0@lo:5: 00000004:00080000:1.0:1788448311.142218:0:9904:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788448311.142240:0:9904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826257920:0@lo:5: 00000100:00100000:1.0:1788448311.142268:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448311.142296:0:9904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548600 going to sleep for 11 seconds 00000100:00100000:2.0:1788448311.142355:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448311.142366:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9910:x1875323826257792:12345-0@lo:700: 00000100:00100000:2.0:1788448311.142482:0:9910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448311.144583:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826257920 00000100:00100000:0.0:1788448311.144598:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826257920 00000100:00100000:0.0:1788448311.144648:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448311.144659:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9904:x1875323826257920:12345-0@lo:5: 00002000:00080000:0.0:1788448311.144701:0:8433:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788448311.150790:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9904:x1875323826257920:12345-0@lo:5: Request processed in 6124us (8511us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788448311.150803:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788448311.156016:0:9904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f4380 x1875323826257920/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448311.156039:0:9904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9904:1875323826257920:0@lo:5: 00000004:00080000:0.0:1788448311.156055:0:9904:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788448311.156107:0:9904:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9904:1875323826258048:0@lo:900: 00000100:00100000:0.0:1788448311.156161:0:9904:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448311.156197:0:9904:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d193c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448311.157182:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258048 00000100:00100000:1.0:1788448311.157191:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258048 00000100:00100000:1.0:1788448311.157269:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448311.157278:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9904:x1875323826258048:12345-0@lo:900: 00000100:00100000:1.0:1788448311.157986:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9904:x1875323826258048:12345-0@lo:900: Request processed in 705us (1820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448311.157995:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788448311.161677:0:9904:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf783100 x1875323826258048/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448311.161695:0:9904:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9904:1875323826258048:0@lo:900: 00000001:00080000:1.0:1788448311.162784:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788448311.163170:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9910:x1875323826257792:12345-0@lo:700: Request processed in 20802us (21320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448311.163182:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788448311.163286:0:9910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424a80 x1875323826257792/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448311.163299:0:9910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826257792:0@lo:700: 00000004:02000040:3.0:1788448311.173403:0:9910:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1788448311.179815:0:9910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826258176:0@lo:5: 00000100:00100000:3.0:1788448311.180915:0:9910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448311.180977:0:9910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860240 going to sleep for 11 seconds 00000100:00100000:1.0:1788448311.181204:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258176 00000100:00100000:1.0:1788448311.181213:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258176 00000100:00100000:1.0:1788448311.181269:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448311.181280:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9910:x1875323826258176:12345-0@lo:5: 00002000:00080000:1.0:1788448311.188507:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788448311.188527:0:8434:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788448311.191279:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9910:x1875323826258176:12345-0@lo:5: Request processed in 9994us (10362us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788448311.191292:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788448311.191379:0:9910:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341ca80 x1875323826258176/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448327 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448311.191395:0:9910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9910:1875323826258176:0@lo:5: 00000004:00080000:3.0:1788448311.191409:0:9910:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1788448311.298340:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448311.533981:0:9937:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448311.534286:0:9937:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788448311.999209:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448311.999237:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826258304:0@lo:41: 00000100:00100000:3.0:1788448311.999305:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448311.999499:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258304 00000100:00100000:2.0:1788448311.999509:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258304 00000100:00100000:2.0:1788448311.999560:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448311.999570:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826258304:12345-0@lo:41: 00000004:00000024:2.0:1788448311.999603:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788448311.999657:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826258304:12345-0@lo:41: Request processed in 87us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448311.999663:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448311.999845:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826258304:0@lo:41: 00010000:00010000:2.0:1788448312.320799:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788448312.506752:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:1.0:1788448313.342670:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448314.046071:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448314.046098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826258432:0@lo:41: 00000100:00100000:3.0:1788448314.046106:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826258560:0@lo:13: 00000100:00100000:1.0:1788448314.048957:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826258688:0@lo:13: 00000100:00100000:2.0:1788448314.049692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448314.049705:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448314.049785:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258432 00000100:00100000:0.0:1788448314.049795:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258432 00000100:00100000:3.0:1788448314.049807:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448314.049849:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788448314.049861:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826258432:12345-0@lo:41: 00000004:00000024:0.0:1788448314.049911:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448314.049964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826258432:12345-0@lo:41: Request processed in 105us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448314.049971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448314.049986:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258688 00000100:00100000:3.0:1788448314.050000:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258688 00000100:00100000:2.0:1788448314.050048:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258560 00000100:00100000:2.0:1788448314.050052:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258560 00000100:00080000:0.0:1788448314.050068:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448314.050080:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448314.050089:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826258688:12345-0@lo:13: 00002000:00000024:2.0:1788448314.050108:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448314.050159:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826258688:12345-0@lo:13: Request processed in 70us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448314.050167:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448314.050183:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448314.050192:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826258560:12345-0@lo:13: 00002000:00000024:2.0:1788448314.050204:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448314.050242:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826258560:12345-0@lo:13: Request processed in 52us (437us total) trans 0 rc 0/0 00010000:00080000:0.0:1788448314.050247:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf783100 x1875323826258688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448314.050267:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448314.050291:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826258688:0@lo:13: 00000100:00100000:2.0:1788448314.050309:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826258432:0@lo:41: 00010000:00080000:3.0:1788448314.050438:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341e680 x1875323826258560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448314.050453:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826258560:0@lo:13: 00010000:00010000:2.0:1788448314.366163:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448314.412532:0:10038:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448314.412862:0:10038:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448315.397274:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448315.432615:0:10086:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448315.432625:0:10086:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788448315.979036:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448315.983841:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043072 00000100:00100000:0.0:1788448315.983960:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043072 00000100:00100000:0.0:1788448315.984060:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 180 00000100:00100000:0.0:1788448315.984072:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875323801043072:12345-192.168.206.21@tcp:250: 00010000:00080000:0.0:1788448315.984112:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 898f976d-b4cc-4a0f-acd9-17aca9f1b33b@192.168.206.21@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:0.0:1788448315.984152:0:6510:0:(genops.c:1385:class_connect()) connect: client 898f976d-b4cc-4a0f-acd9-17aca9f1b33b, cookie 0xf45a9e4e6b8036bb 00000100:00080000:0.0:1788448315.984344:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9fc0834fb800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448315.984515:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+5:2397:x1875323801043072:12345-192.168.206.21@tcp:250: Request processed in 442us (5493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448315.984525:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 180 00000100:00100000:1.0:1788448315.998659:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448315.999719:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043200 00000100:00100000:0.0:1788448315.999732:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043200 00000100:00100000:0.0:1788448315.999794:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 181 00000100:00100000:0.0:1788448315.999804:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+5:6157:x1875323801043200:12345-192.168.206.21@tcp:101: 00010000:00010000:0.0:1788448315.999819:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448315.999835:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0456 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448315.999996:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.000010:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.000030:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:0.0:1788448316.000126:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+6:6157:x1875323801043200:12345-192.168.206.21@tcp:101: Request processed in 323us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.000134:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 181 00000100:00100000:3.0:1788448316.004674:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.005204:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043328 00000100:00100000:0.0:1788448316.005219:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043328 00000100:00100000:2.0:1788448316.005385:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:2.0:1788448316.005418:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+6:6157:x1875323801043328:12345-192.168.206.21@tcp:501: 00000100:00100000:2.0:1788448316.005563:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+6:6157:x1875323801043328:12345-192.168.206.21@tcp:501: Request processed in 157us (1130us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788448316.005572:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:3.0:1788448316.012051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.013312:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043456 00000100:00100000:0.0:1788448316.013330:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043456 00000100:00100000:0.0:1788448316.013418:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 183 00000100:00100000:0.0:1788448316.013431:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+6:6157:x1875323801043456:12345-192.168.206.21@tcp:101: 00010000:00010000:0.0:1788448316.013517:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448316.013542:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e045d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.013587:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.013600:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.013611:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448316.015930:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+7:6157:x1875323801043456:12345-192.168.206.21@tcp:101: Request processed in 2483us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.015947:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 183 00000100:00100000:1.0:1788448316.020142:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.020266:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043584 00000100:00100000:0.0:1788448316.020280:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043584 00000100:00100000:0.0:1788448316.020352:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00100000:0.0:1788448316.020382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+7:6157:x1875323801043584:12345-192.168.206.21@tcp:501: 00000100:00100000:0.0:1788448316.021338:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6157:x1875323801043584:12345-192.168.206.21@tcp:501: Request processed in 949us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.021353:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00100000:3.0:1788448316.029092:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448316.029276:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043712 00000100:00100000:2.0:1788448316.029290:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043712 00000100:00100000:2.0:1788448316.029375:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:2.0:1788448316.029388:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6157:x1875323801043712:12345-192.168.206.21@tcp:503: 00000100:00100000:2.0:1788448316.031601:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6157:x1875323801043712:12345-192.168.206.21@tcp:503: Request processed in 2198us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.031617:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:2.0:1788448316.036366:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.036499:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043840 00000100:00100000:0.0:1788448316.036513:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043840 00000100:00100000:0.0:1788448316.036587:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:0.0:1788448316.036600:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6176:x1875323801043840:12345-192.168.206.21@tcp:502: 00000100:00100000:0.0:1788448316.036822:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6176:x1875323801043840:12345-192.168.206.21@tcp:502: Request processed in 224us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.036831:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:1.0:1788448316.077608:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448316.077866:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801043968 00000100:00100000:2.0:1788448316.077921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801043968 00000100:00100000:2.0:1788448316.078002:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:2.0:1788448316.078015:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6176:x1875323801043968:12345-192.168.206.21@tcp:502: 00000100:00100000:2.0:1788448316.078236:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6176:x1875323801043968:12345-192.168.206.21@tcp:502: Request processed in 222us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.078246:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:1.0:1788448316.082811:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.083090:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044096 00000100:00100000:0.0:1788448316.083107:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044096 00000100:00100000:0.0:1788448316.083247:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 188 00000100:00100000:0.0:1788448316.083262:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6157:x1875323801044096:12345-192.168.206.21@tcp:101: 00010000:00010000:0.0:1788448316.083290:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448316.083317:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b8036d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e048e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.083356:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b8036d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e048e expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.083368:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b8036d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e048e expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448316.083380:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ea00, rc 0) 00000100:00100000:0.0:1788448316.083455:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6157:x1875323801044096:12345-192.168.206.21@tcp:101: Request processed in 196us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.083481:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 188 00000100:00100000:1.0:1788448316.095176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826258944:0@lo:400: 00000100:00100000:1.0:1788448316.095271:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095346:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826259456:0@lo:400: 00000100:00100000:1.0:1788448316.095370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095393:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826259968:0@lo:400: 00000100:00100000:1.0:1788448316.095414:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095442:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788448316.095447:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826258816:0@lo:400: 00000100:00100000:1.0:1788448316.095501:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095522:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826259328:0@lo:400: 00000100:00100000:1.0:1788448316.095546:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095567:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826259840:0@lo:400: 00000100:00100000:1.0:1788448316.095590:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260352:0@lo:400: 00000100:00100000:1.0:1788448316.095630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448316.095665:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259328 00000100:00100000:1.0:1788448316.095673:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259328 00000100:00100000:1.0:1788448316.095725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788448316.095736:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826259328:12345-0@lo:400: 00000100:00100000:1.0:1788448316.095801:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826259328:12345-0@lo:400: Request processed in 66us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448316.095808:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788448316.095833:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259840 00000100:00100000:1.0:1788448316.095836:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259840 00000100:00100000:1.0:1788448316.095865:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260352 00000100:00100000:1.0:1788448316.095867:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260352 00000100:00100000:1.0:1788448316.095915:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448316.095922:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826259840:12345-0@lo:400: 00000100:00100000:1.0:1788448316.095951:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826259840:12345-0@lo:400: Request processed in 31us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448316.095957:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448316.095967:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448316.095972:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260352:12345-0@lo:400: 00000100:00100000:1.0:1788448316.096008:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260352:12345-0@lo:400: Request processed in 36us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448316.096021:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448316.096066:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826259328:0@lo:400: 00010000:00080000:1.0:1788448316.096081:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796300 x1875323826259840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.096091:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826259840:0@lo:400: 00010000:00080000:1.0:1788448316.096100:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797800 x1875323826260352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.096107:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788448316.096123:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260352:0@lo:400: 00000100:00100000:0.0:1788448316.097353:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826259200:0@lo:400: 00000100:00100000:2.0:1788448316.097412:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258944 00000100:00100000:0.0:1788448316.097423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448316.097432:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258944 00000100:00100000:2.0:1788448316.097528:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259456 00000100:00100000:2.0:1788448316.097533:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259456 00000100:00100000:2.0:1788448316.097554:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259968 00000100:00100000:2.0:1788448316.097558:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259968 00000100:00100000:2.0:1788448316.097571:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259200 00000100:00100000:2.0:1788448316.097573:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259200 00000100:00100000:2.0:1788448316.097589:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448316.097597:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826258944:12345-0@lo:400: 00000100:00100000:2.0:1788448316.097658:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826258944:12345-0@lo:400: Request processed in 63us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.097665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448316.097681:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448316.097687:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826259456:12345-0@lo:400: 00000100:00100000:2.0:1788448316.097715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826259456:12345-0@lo:400: Request processed in 29us (2345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.097720:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448316.097731:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448316.097737:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826259968:12345-0@lo:400: 00000100:00100000:2.0:1788448316.097764:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826259968:12345-0@lo:400: Request processed in 27us (2350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.097770:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448316.097780:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448316.097787:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826259200:12345-0@lo:400: 00000100:00100000:2.0:1788448316.097813:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826259200:12345-0@lo:400: Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.097819:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788448316.097950:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796d80 x1875323826259200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448316.097963:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826259200:0@lo:400: 00000100:00100000:0.0:1788448316.097971:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826259712:0@lo:400: 00000100:00100000:0.0:1788448316.098077:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448316.098102:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826260224:0@lo:400: 00000100:00100000:0.0:1788448316.098123:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448316.098162:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788448316.098169:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826259072:0@lo:400: 00000100:00100000:0.0:1788448316.098212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448316.098234:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826259584:0@lo:400: 00000100:00100000:0.0:1788448316.098256:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448316.098269:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826260096:0@lo:400: 00000100:00100000:0.0:1788448316.098291:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448316.098321:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259712 00000100:00100000:0.0:1788448316.098326:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259712 00000100:00100000:0.0:1788448316.098354:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260224 00000100:00100000:0.0:1788448316.098357:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260224 00000100:00100000:0.0:1788448316.098375:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448316.098381:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826259712:12345-0@lo:400: 00000100:00100000:1.0:1788448316.098409:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259584 00000100:00100000:1.0:1788448316.098413:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259584 00000100:00100000:0.0:1788448316.098416:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826259712:12345-0@lo:400: Request processed in 35us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.098431:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448316.098436:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260096 00000100:00100000:1.0:1788448316.098438:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260096 00000100:00100000:1.0:1788448316.098452:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448316.098458:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826259584:12345-0@lo:400: 00000100:00100000:1.0:1788448316.098493:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826259584:12345-0@lo:400: Request processed in 35us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448316.098499:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448316.098512:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788448316.098518:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826260096:12345-0@lo:400: 00000100:00100000:0.0:1788448316.098522:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448316.098527:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826260224:12345-0@lo:400: 00000100:00100000:1.0:1788448316.098545:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826260096:12345-0@lo:400: Request processed in 27us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448316.098551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788448316.098587:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424a80 x1875323826258944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.098611:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826258944:0@lo:400: 00010000:00080000:1.0:1788448316.098625:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797100 x1875323826259456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.098633:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826259456:0@lo:400: 00010000:00080000:1.0:1788448316.098645:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797b80 x1875323826259968/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.098653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826259968:0@lo:400: 00000100:00080000:1.0:1788448316.098702:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448316.098707:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448316.098709:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448316.098712:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448316.098724:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826259072 00000100:00100000:1.0:1788448316.098727:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826259072 00000100:00100000:1.0:1788448316.098750:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448316.098756:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826259072:12345-0@lo:400: 00000100:00100000:1.0:1788448316.098791:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826259072:12345-0@lo:400: Request processed in 35us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448316.098797:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448316.098845:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826259072:0@lo:400: 00010000:00080000:1.0:1788448316.098855:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb795880 x1875323826259584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.098864:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826259584:0@lo:400: 00010000:00080000:1.0:1788448316.098910:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb795500 x1875323826260096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.098932:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826260096:0@lo:400: 00010000:00080000:1.0:1788448316.098944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb794380 x1875323826259712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.098951:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826259712:0@lo:400: 00000100:00100000:3.0:1788448316.100462:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826258816 00000100:00100000:3.0:1788448316.100481:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826258816 00000100:00100000:3.0:1788448316.100534:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788448316.100545:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826258816:12345-0@lo:400: 00000100:00100000:3.0:1788448316.100642:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826258816:12345-0@lo:400: Request processed in 98us (5139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448316.100649:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1788448316.100710:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826258816:0@lo:400: 00000100:00100000:0.0:1788448316.100917:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826260224:12345-0@lo:400: Request processed in 2386us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.100927:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788448316.103442:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb795180 x1875323826260224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448316.103460:0:3648:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788448316.103482:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826260224:0@lo:400: 00000100:00100000:2.0:1788448316.103718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.104248:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044224 00000100:00100000:0.0:1788448316.104260:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044224 00000100:00100000:0.0:1788448316.104339:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 190 00000100:00100000:0.0:1788448316.104351:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6157:x1875323801044224:12345-192.168.206.21@tcp:256: 20000000:01000000:0.0:1788448316.104382:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788448316.104405:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788448316.104409:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788448316.104412:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788448316.104415:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788448316.104418:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788448316.106796:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6157:x1875323801044224:12345-192.168.206.21@tcp:256: Request processed in 2430us (3063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.106815:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 190 00000100:00100000:1.0:1788448316.111733:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448316.112086:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044352 00000100:00100000:3.0:1788448316.112099:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044352 00000100:00100000:3.0:1788448316.112212:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:3.0:1788448316.112224:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6157:x1875323801044352:12345-192.168.206.21@tcp:101: 00010000:00010000:3.0:1788448316.112245:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448316.112265:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0495 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448316.112333:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448316.112347:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448316.112358:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e800, rc 0) 00000100:00100000:3.0:1788448316.112430:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6157:x1875323801044352:12345-192.168.206.21@tcp:101: Request processed in 209us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448316.112438:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:2.0:1788448316.114505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.114779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044480 00000100:00100000:0.0:1788448316.114791:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044480 00000100:00100000:0.0:1788448316.115071:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 192 00000100:00100000:0.0:1788448316.115085:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6157:x1875323801044480:12345-192.168.206.21@tcp:501: 00000100:00100000:0.0:1788448316.115275:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6157:x1875323801044480:12345-192.168.206.21@tcp:501: Request processed in 192us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.115283:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 192 00000100:00100000:1.0:1788448316.117205:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448316.117300:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044608 00000100:00100000:3.0:1788448316.117320:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044608 00000100:00100000:3.0:1788448316.117389:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:3.0:1788448316.117401:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6157:x1875323801044608:12345-192.168.206.21@tcp:503: 00000100:00100000:3.0:1788448316.117600:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6157:x1875323801044608:12345-192.168.206.21@tcp:503: Request processed in 201us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448316.117610:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:1.0:1788448316.122569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.123440:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044736 00000100:00100000:0.0:1788448316.123455:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044736 00000100:00100000:0.0:1788448316.123538:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:0.0:1788448316.123550:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6181:x1875323801044736:12345-192.168.206.21@tcp:502: 00000100:00100000:0.0:1788448316.123771:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6181:x1875323801044736:12345-192.168.206.21@tcp:502: Request processed in 222us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.123780:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:2.0:1788448316.133433:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448316.134095:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044864 00000100:00100000:0.0:1788448316.134110:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044864 00000100:00100000:0.0:1788448316.134186:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:0.0:1788448316.134199:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6181:x1875323801044864:12345-192.168.206.21@tcp:502: 00000100:00100000:0.0:1788448316.134406:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6181:x1875323801044864:12345-192.168.206.21@tcp:502: Request processed in 209us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448316.134416:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:1.0:1788448316.144335:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448316.144390:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448316.147636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801044992 00000100:00100000:2.0:1788448316.147659:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801044992 00000100:00100000:2.0:1788448316.147810:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045248 00000100:00100000:2.0:1788448316.147815:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045248 00000100:00100000:2.0:1788448316.147915:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1788448316.147927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875323801044992:12345-192.168.206.21@tcp:38: 00010000:00080000:2.0:1788448316.147969:0:6517:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1788448316.148078:0:6517:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b8036de 00000004:00100000:2.0:1788448316.148110:0:6517:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788448316.148406:0:6517:0:(import.c:65:import_set_state_nolock()) ffff9fc082760800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448316.148569:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1788448316.148577:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875323801045248:12345-192.168.206.21@tcp:38: 00010000:00080000:3.0:1788448316.148597:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:3.0:1788448316.148635:0:6518:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b8036e5 00000004:00100000:3.0:1788448316.148652:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788448316.148818:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9fc1b5c9e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448316.148915:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801045248:12345-192.168.206.21@tcp:38: Request processed in 335us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448316.148945:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:2.0:1788448316.149180:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801044992:12345-192.168.206.21@tcp:38: Request processed in 1254us (4859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.149188:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00010000:00010000:2.0:1788448316.414225:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448316.607770:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260480:0@lo:13: 00000100:00100000:2.0:1788448316.607863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448316.608048:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260480 00000100:00100000:3.0:1788448316.608059:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260480 00000100:00100000:3.0:1788448316.608122:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448316.608134:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260480:12345-0@lo:13: 00002000:00000024:3.0:1788448316.608170:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448316.608223:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260480:12345-0@lo:13: Request processed in 90us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448316.608230:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788448316.608321:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341e680 x1875323826260480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448316.608343:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260480:0@lo:13: 00000100:00100000:3.0:1788448316.608606:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826260608:0@lo:13: 00000100:00100000:3.0:1788448316.608640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448316.608709:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260608 00000100:00100000:2.0:1788448316.608714:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260608 00000100:00100000:2.0:1788448316.608746:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448316.608753:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826260608:12345-0@lo:13: 00002000:00000024:2.0:1788448316.608766:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448316.612223:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826260608:12345-0@lo:13: Request processed in 3456us (3568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448316.612262:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788448316.613842:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f7480 x1875323826260608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448316.614002:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826260608:0@lo:13: 00000100:00100000:0.0:1788448317.120317:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826260736:0@lo:41: 00000100:00100000:0.0:1788448317.120413:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448317.120590:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260736 00000100:00100000:1.0:1788448317.120600:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260736 00000100:00100000:1.0:1788448317.120678:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788448317.120690:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826260736:12345-0@lo:41: 00000004:00000024:1.0:1788448317.120735:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788448317.120799:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826260736:12345-0@lo:41: Request processed in 111us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448317.120807:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448317.120949:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826260736:0@lo:41: 00000100:00100000:3.0:1788448317.162938:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448317.163664:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045376 00000100:00100000:2.0:1788448317.163680:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045376 00000100:00100000:2.0:1788448317.163793:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448317.163807:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801045376:12345-192.168.206.21@tcp:41: 00000004:00000024:2.0:1788448317.163858:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448317.163999:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801045376:12345-192.168.206.21@tcp:41: Request processed in 195us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448317.164008:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00080000:1.0:1788448317.164086:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448317.169663:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448317.171895:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045504 00000100:00100000:1.0:1788448317.171915:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045504 00000100:00100000:1.0:1788448317.172121:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1788448317.172156:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6157:x1875323801045504:12345-192.168.206.21@tcp:41: 00000004:00000024:1.0:1788448317.172199:0:9023:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788448317.172300:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6157:x1875323801045504:12345-192.168.206.21@tcp:41: Request processed in 148us (2651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448317.172308:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448317.175017:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448317.177997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788448317.178074:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448317.182786:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045632 00000100:00100000:2.0:1788448317.182806:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045632 00000100:00100000:1.0:1788448317.182832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045120 00000100:00100000:1.0:1788448317.182841:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045120 00000100:00100000:2.0:1788448317.182939:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1788448317.182954:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:6157:x1875323801045632:12345-192.168.206.21@tcp:40: 00000100:00100000:2.0:1788448317.183100:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:6157:x1875323801045632:12345-192.168.206.21@tcp:40: Request processed in 149us (8096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448317.183108:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1788448317.184282:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448317.184297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801045120:12345-192.168.206.21@tcp:41: 00000004:00000024:1.0:1788448317.184357:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788448317.184437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801045120:12345-192.168.206.21@tcp:41: Request processed in 142us (6464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448317.184445:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1788448317.187457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448317.187505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448317.187543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448317.187587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448317.187621:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046144 00000100:00100000:3.0:1788448317.187633:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046144 00000100:00100000:3.0:1788448317.187690:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:3.0:1788448317.187702:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801046144:12345-192.168.206.21@tcp:400: 00000100:00100000:3.0:1788448317.187815:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801046144:12345-192.168.206.21@tcp:400: Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448317.187825:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:2.0:1788448317.189554:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045760 00000100:00100000:2.0:1788448317.189581:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045760 00000100:00100000:2.0:1788448317.189636:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801045888 00000100:00100000:2.0:1788448317.189640:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801045888 00000100:00100000:2.0:1788448317.189669:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448317.189678:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875323801045760:12345-192.168.206.21@tcp:8: 00010000:00080000:2.0:1788448317.189717:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:2.0:1788448317.189758:0:8434:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b8036ec 00002000:00100000:2.0:1788448317.189773:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f39813a-d0bd-49ee-95eb-2130028b48f0/ffff9fc082763000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448317.189811:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448317.190690:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448317.190738:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9fc082763800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448317.190838:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801045760:12345-192.168.206.21@tcp:8: Request processed in 1158us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448317.190991:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046016 00000100:00100000:1.0:1788448317.190998:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046016 00000100:00100000:1.0:1788448317.191067:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:1.0:1788448317.191077:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6157:x1875323801046016:12345-192.168.206.21@tcp:900: 00000100:00100000:1.0:1788448317.192069:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6157:x1875323801046016:12345-192.168.206.21@tcp:900: Request processed in 979us (4612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448317.192081:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1788448317.192967:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:3.0:1788448317.193409:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1788448317.193420:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875323801045888:12345-192.168.206.21@tcp:8: 00010000:00080000:3.0:1788448317.193464:0:8539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 234 last 0 00000020:00000080:3.0:1788448317.193507:0:8539:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b8036f3 00002000:00100000:3.0:1788448317.193522:0:8539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f39813a-d0bd-49ee-95eb-2130028b48f0/ffff9fc1b5c9d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788448317.193537:0:8539:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788448317.194492:0:8539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788448317.194540:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9fc1b5c9f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448317.194645:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801045888:12345-192.168.206.21@tcp:8: Request processed in 1224us (7100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448317.194655:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1788448317.194742:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448317.195269:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046272 00000100:00100000:3.0:1788448317.195280:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046272 00000100:00100000:3.0:1788448317.195327:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1788448317.195337:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6157:x1875323801046272:12345-192.168.206.21@tcp:33: 00000004:00080000:3.0:1788448317.220901:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25470us 00000004:00200000:3.0:1788448317.240781:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788448317.240904:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6157:x1875323801046272:12345-192.168.206.21@tcp:33: Request processed in 45562us (46157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448317.240914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1788448317.438370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448317.438768:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046400 00000100:00100000:2.0:1788448317.438784:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046400 00000100:00100000:2.0:1788448317.438861:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1788448317.438878:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6199:x1875323801046400:12345-192.168.206.21@tcp:101: 00010000:00010000:2.0:1788448317.438939:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448317.440855:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448317.441043:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680800/0xf45a9e4e6b8036fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e04c6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448317.441120:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680c00/0xf45a9e4e6b803701 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448317.441133:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680c00/0xf45a9e4e6b803701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448317.441146:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680c00/0xf45a9e4e6b803701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448317.441192:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448317.441195:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448317.441444:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680c00/0xf45a9e4e6b803701 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448317.441476:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680800/0xf45a9e4e6b8036fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04c6 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448317.441514:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680c00/0xf45a9e4e6b803701 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04c6 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448317.441523:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1a0b31100) 00010000:00010000:2.0:1788448317.441525:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448317.441529:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181680c00, rc 0) 00000100:00100000:2.0:1788448317.441604:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:6199:x1875323801046400:12345-192.168.206.21@tcp:101: Request processed in 2732us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448317.441614:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00010000:00010000:2.0:1788448318.462200:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448319.166155:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260992:0@lo:13: 00000100:00100000:1.0:1788448319.166229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448319.166311:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448319.166317:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260864:0@lo:41: 00000100:00100000:1.0:1788448319.166343:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448319.166433:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260992 00000100:00100000:2.0:1788448319.166441:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260992 00000100:00100000:2.0:1788448319.166512:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448319.166524:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260992:12345-0@lo:13: 00002000:00000024:2.0:1788448319.166550:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448319.166596:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260992:12345-0@lo:13: Request processed in 75us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448319.166602:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448319.166718:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826260864 00000100:00100000:3.0:1788448319.166723:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826260864 00000100:00100000:3.0:1788448319.166760:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448319.166768:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260864:12345-0@lo:41: 00000004:00000024:3.0:1788448319.166789:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448319.166825:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826260864:12345-0@lo:41: Request processed in 58us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448319.166831:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788448319.168639:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448319.168691:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260864:0@lo:41: 00010000:00080000:1.0:1788448319.168708:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341d500 x1875323826260992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448319.168723:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826260992:0@lo:13: 00000100:00100000:0.0:1788448319.168729:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448319.168745:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826261120:0@lo:13: 00000100:00100000:0.0:1788448319.168797:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448319.171336:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261120 00000100:00100000:3.0:1788448319.171351:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261120 00000100:00100000:3.0:1788448319.171442:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448319.171453:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826261120:12345-0@lo:13: 00002000:00000024:3.0:1788448319.171477:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448319.171566:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826261120:12345-0@lo:13: Request processed in 114us (2768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448319.171573:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1788448319.171682:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788448319.171831:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341f800 x1875323826261120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448319.171854:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826261120:0@lo:13: 00010000:00010000:2.0:1788448319.486754:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448319.652997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448319.656147:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046528 00000100:00100000:2.0:1788448319.656171:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046528 00000100:00100000:2.0:1788448319.656298:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1788448319.656312:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:6251:x1875323801046528:12345-192.168.206.21@tcp:41: 00000004:00000024:2.0:1788448319.656366:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788448319.656460:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:6251:x1875323801046528:12345-192.168.206.21@tcp:41: Request processed in 152us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448319.656491:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00080000:1.0:1788448319.656823:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448319.664933:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448319.665099:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046656 00000100:00100000:3.0:1788448319.665111:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046656 00000100:00100000:3.0:1788448319.665197:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1788448319.665210:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6251:x1875323801046656:12345-192.168.206.21@tcp:41: 00000004:00000024:3.0:1788448319.665266:0:9023:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448319.665344:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6251:x1875323801046656:12345-192.168.206.21@tcp:41: Request processed in 137us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448319.665353:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00080000:1.0:1788448319.665473:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448319.671462:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448319.671644:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046784 00000100:00100000:2.0:1788448319.671657:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046784 00000100:00100000:2.0:1788448319.671743:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:2.0:1788448319.671755:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6251:x1875323801046784:12345-192.168.206.21@tcp:13: 00002000:00000024:2.0:1788448319.671787:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448319.671919:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6251:x1875323801046784:12345-192.168.206.21@tcp:13: Request processed in 130us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448319.671928:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00080000:1.0:1788448319.679277:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448319.682411:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448319.682510:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801046912 00000100:00100000:2.0:1788448319.682524:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801046912 00000100:00100000:2.0:1788448319.682608:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1788448319.682620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6251:x1875323801046912:12345-192.168.206.21@tcp:13: 00002000:00000024:2.0:1788448319.682670:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448319.682759:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:6251:x1875323801046912:12345-192.168.206.21@tcp:13: Request processed in 141us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448319.682768:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00080000:1.0:1788448319.682849:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788448320.510129:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448321.217997:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826261248:0@lo:400: 00000100:00100000:0.0:1788448321.218106:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448321.218174:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826261760:0@lo:400: 00000100:00100000:0.0:1788448321.218205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448321.218229:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826262272:0@lo:400: 00000100:00100000:0.0:1788448321.218253:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448321.218302:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788448321.218309:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826261632:0@lo:400: 00000100:00100000:0.0:1788448321.218336:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448321.218361:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826262144:0@lo:400: 00000100:00100000:0.0:1788448321.218383:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448321.218424:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261760 00000100:00100000:0.0:1788448321.218433:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261760 00000100:00100000:0.0:1788448321.218487:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448321.218497:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826261760:12345-0@lo:400: 00000100:00100000:0.0:1788448321.218564:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826261760:12345-0@lo:400: Request processed in 68us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448321.218572:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448321.218601:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262272 00000100:00100000:0.0:1788448321.218605:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262272 00000100:00100000:0.0:1788448321.218640:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262144 00000100:00100000:0.0:1788448321.218644:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262144 00000100:00100000:0.0:1788448321.218662:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448321.218668:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826262272:12345-0@lo:400: 00000100:00100000:0.0:1788448321.219012:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826262272:12345-0@lo:400: Request processed in 341us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448321.219036:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448321.219053:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448321.219059:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826262144:12345-0@lo:400: 00000100:00100000:0.0:1788448321.219090:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826262144:12345-0@lo:400: Request processed in 31us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448321.219096:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788448321.219138:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f3480 x1875323826262144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448321.219153:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826262144:0@lo:400: 00000100:00100000:0.0:1788448321.219164:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826261760:0@lo:400: 00010000:00080000:0.0:1788448321.219173:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0a80 x1875323826262272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448321.219181:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826262272:0@lo:400: 00000100:00100000:3.0:1788448321.219317:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261248 00000100:00100000:3.0:1788448321.219323:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261248 00000100:00100000:3.0:1788448321.219369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788448321.219377:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826261248:12345-0@lo:400: 00000100:00100000:3.0:1788448321.219420:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826261248:12345-0@lo:400: Request processed in 45us (1315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.219426:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788448321.219464:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826261248:0@lo:400: 00000100:00100000:3.0:1788448321.219508:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261632 00000100:00100000:3.0:1788448321.219513:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261632 00000100:00100000:3.0:1788448321.219539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448321.219546:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826261632:12345-0@lo:400: 00000100:00100000:3.0:1788448321.219581:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826261632:12345-0@lo:400: Request processed in 35us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.219587:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448321.219613:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826261632:0@lo:400: 00000100:00100000:3.0:1788448321.219655:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826261504:0@lo:400: 00000100:00100000:3.0:1788448321.219970:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.219998:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826262016:0@lo:400: 00000100:00100000:3.0:1788448321.220026:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.220046:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788448321.220054:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826261376:0@lo:400: 00000100:00100000:3.0:1788448321.220076:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.220095:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826261888:0@lo:400: 00000100:00100000:3.0:1788448321.220138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.220180:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262016 00000100:00100000:3.0:1788448321.220184:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262016 00000100:00100000:3.0:1788448321.220210:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261376 00000100:00100000:3.0:1788448321.220212:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261376 00000100:00100000:3.0:1788448321.220225:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261888 00000100:00100000:3.0:1788448321.220227:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261888 00000100:00100000:3.0:1788448321.220242:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448321.220248:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826262016:12345-0@lo:400: 00000100:00100000:3.0:1788448321.220373:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826262016:12345-0@lo:400: Request processed in 124us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.220379:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448321.220394:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448321.220400:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826261376:12345-0@lo:400: 00000100:00100000:3.0:1788448321.220428:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826261376:12345-0@lo:400: Request processed in 29us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.220434:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448321.220446:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448321.220452:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826261888:12345-0@lo:400: 00000100:00100000:3.0:1788448321.220478:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826261888:12345-0@lo:400: Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.220483:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448321.220515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826261376:0@lo:400: 00000100:00100000:3.0:1788448321.220526:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826261888:0@lo:400: 00010000:00080000:3.0:1788448321.220537:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f1f80 x1875323826262016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448321.220547:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826262016:0@lo:400: 00000100:00080000:3.0:1788448321.220607:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448321.220613:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448321.220616:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448321.220751:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826261504 00000100:00100000:0.0:1788448321.220756:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826261504 00000100:00100000:0.0:1788448321.220793:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448321.220802:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826261504:12345-0@lo:400: 00000100:00100000:0.0:1788448321.220856:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826261504:12345-0@lo:400: Request processed in 56us (1168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448321.220863:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448321.220912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826261504:0@lo:400: 00000100:00100000:1.0:1788448321.221194:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826262656:0@lo:400: 00000100:00100000:1.0:1788448321.221232:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448321.221255:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448321.221260:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826262784:0@lo:400: 00000100:00100000:1.0:1788448321.221379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448321.221405:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262656 00000100:00100000:1.0:1788448321.221409:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262656 00000100:00100000:1.0:1788448321.221444:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262784 00000100:00100000:1.0:1788448321.221447:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262784 00000100:00100000:1.0:1788448321.221467:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448321.221475:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826262656:12345-0@lo:400: 00000100:00100000:1.0:1788448321.221511:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826262656:12345-0@lo:400: Request processed in 37us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448321.221518:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448321.221532:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448321.221538:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826262784:12345-0@lo:400: 00000100:00100000:1.0:1788448321.221563:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826262784:12345-0@lo:400: Request processed in 26us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448321.221579:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788448321.221599:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788448321.221618:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7c9c00 x1875323826262784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448321.221627:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826262784:0@lo:400: 00010000:00080000:1.0:1788448321.221636:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7caa00 x1875323826262656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448321.221644:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826262656:0@lo:400: 00000100:00100000:1.0:1788448321.221661:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826262528:0@lo:400: 00000100:00100000:0.0:1788448321.221856:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826262400:0@lo:400: 00000100:00100000:1.0:1788448321.222025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.222518:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262528 00000100:00100000:3.0:1788448321.222527:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262528 00000100:00100000:3.0:1788448321.222590:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448321.222599:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826262528:12345-0@lo:400: 00000100:00100000:3.0:1788448321.222675:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826262528:12345-0@lo:400: Request processed in 77us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.222682:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448321.222847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.223040:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262400 00000100:00100000:3.0:1788448321.223045:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262400 00000100:00100000:3.0:1788448321.223085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448321.223092:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826262400:12345-0@lo:400: 00000100:00100000:3.0:1788448321.223131:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826262400:12345-0@lo:400: Request processed in 40us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.223137:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448321.223303:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826262400:0@lo:400: 00000100:00080000:1.0:1788448321.223798:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448321.223804:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788448321.223845:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cb800 x1875323826262528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448321.223857:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826262528:0@lo:400: 00010000:00010000:1.0:1788448321.534117:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448321.727249:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826262912:0@lo:13: 00000100:00100000:3.0:1788448321.728391:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.728504:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826262912 00000100:00100000:3.0:1788448321.728514:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826262912 00000100:00100000:3.0:1788448321.728582:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788448321.728595:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826262912:12345-0@lo:13: 00002000:00000024:3.0:1788448321.728633:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448321.729031:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826262912:12345-0@lo:13: Request processed in 437us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.729039:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788448321.729106:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cc700 x1875323826262912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448321.729130:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826262912:0@lo:13: 00000100:00100000:3.0:1788448321.732091:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826263040:0@lo:13: 00000100:00100000:3.0:1788448321.732178:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448321.732250:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826263040 00000100:00100000:3.0:1788448321.732257:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826263040 00000100:00100000:3.0:1788448321.732305:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448321.732314:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826263040:12345-0@lo:13: 00002000:00000024:3.0:1788448321.732352:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448321.732393:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826263040:12345-0@lo:13: Request processed in 80us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448321.732401:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788448321.732443:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cc700 x1875323826263040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448321.732463:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826263040:0@lo:13: 00000001:00100000:1.0:1788448321.741715:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000001:00100000:1.0:1788448321.741763:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000001:00100000:3.0:1788448321.742311:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000100:00100000:1.0:1788448322.239533:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826263168:0@lo:41: 00000100:00100000:1.0:1788448322.239621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448322.239756:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826263168 00000100:00100000:2.0:1788448322.239767:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826263168 00000100:00100000:2.0:1788448322.239833:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788448322.239844:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826263168:12345-0@lo:41: 00000004:00000024:2.0:1788448322.239915:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788448322.239973:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826263168:12345-0@lo:41: Request processed in 131us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448322.239981:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448322.240119:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826263168:0@lo:41: 00000100:00100000:0.0:1788448322.408055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448322.408159:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448322.408193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448322.408220:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448322.408251:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448322.408282:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047296 00000100:00100000:0.0:1788448322.408295:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047296 00000100:00100000:0.0:1788448322.408368:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047168 00000100:00100000:0.0:1788448322.408372:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047168 00000100:00100000:0.0:1788448322.408401:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1788448322.408414:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801047296:12345-192.168.206.21@tcp:400: 00000100:00100000:0.0:1788448322.408510:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801047296:12345-192.168.206.21@tcp:400: Request processed in 99us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448322.408519:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1788448322.408539:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1788448322.408546:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801047168:12345-192.168.206.21@tcp:400: 00000100:00100000:0.0:1788448322.408571:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801047168:12345-192.168.206.21@tcp:400: Request processed in 26us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448322.408578:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1788448322.416531:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047040 00000100:00100000:1.0:1788448322.416558:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047040 00000100:00100000:1.0:1788448322.416637:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 198 00000100:00100000:1.0:1788448322.416670:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801047040:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1788448322.417228:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801047040:12345-192.168.206.21@tcp:400: Request processed in 556us (9184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448322.417239:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 198 00000100:00100000:1.0:1788448322.417288:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047552 00000100:00100000:1.0:1788448322.417294:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047552 00000100:00100000:1.0:1788448322.417331:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047424 00000100:00100000:1.0:1788448322.417335:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047424 00000100:00100000:1.0:1788448322.417375:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1788448322.417383:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801047552:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1788448322.417418:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801047552:12345-192.168.206.21@tcp:400: Request processed in 37us (9225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448322.417426:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1788448322.417439:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1788448322.417446:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801047424:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1788448322.417471:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801047424:12345-192.168.206.21@tcp:400: Request processed in 25us (9219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448322.417478:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00080000:1.0:1788448322.417500:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448322.417505:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448322.417508:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448322.417511:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:0.0:1788448322.449401:0:10184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788448322.560114:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448322.757818:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00010000:00010000:2.0:1788448323.584809:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448324.288399:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448324.288428:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826263296:0@lo:41: 00000100:00100000:2.0:1788448324.288498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448324.288679:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826263296 00000100:00100000:1.0:1788448324.288697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826263296 00000100:00100000:1.0:1788448324.288784:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448324.288798:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826263296:12345-0@lo:41: 00000004:00000024:1.0:1788448324.288922:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448324.288965:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826263424:0@lo:13: 00000100:00100000:1.0:1788448324.289030:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826263296:12345-0@lo:41: Request processed in 233us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448324.289038:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448324.289080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448324.289241:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826263424 00000100:00100000:1.0:1788448324.289248:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826263424 00000100:00100000:1.0:1788448324.289306:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788448324.289318:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826263424:12345-0@lo:13: 00000100:00080000:3.0:1788448324.289326:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788448324.289344:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448324.289407:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826263424:12345-0@lo:13: Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448324.289412:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448324.289485:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826263296:0@lo:41: 00000100:00100000:2.0:1788448324.289604:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826263552:0@lo:13: 00000100:00100000:2.0:1788448324.289637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788448324.289968:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cc700 x1875323826263424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448324.289992:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826263424:0@lo:13: 00000100:00100000:1.0:1788448324.292716:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826263552 00000100:00100000:1.0:1788448324.292731:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826263552 00000100:00100000:1.0:1788448324.292816:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448324.292827:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826263552:12345-0@lo:13: 00002000:00000024:1.0:1788448324.292852:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1788448324.293055:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448324.298871:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826263552:12345-0@lo:13: Request processed in 6036us (9224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448324.298901:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788448324.309091:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b5f80 x1875323826263552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448324.309122:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826263552:0@lo:13: 00010000:00010000:2.0:1788448324.606067:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448325.630082:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448325.891660:0:10332:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcf3d0fa70 20000000:00000080:2.0:1788448325.891687:0:10332:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc1ba295c00 uarg=0000000000000000 20000000:01000000:2.0:1788448325.891757:0:10332:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788448325.891760:0:10332:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788448325.891763:0:10332:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788448325.891769:0:10332:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788448325.892221:0:10332:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788448325.892305:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788448325.892308:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788448325.892809:0:10333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788448325.893265:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788448325.893297:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788448325.893311:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788448325.893491:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788448325.893494:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788448325.894139:0:10334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788448325.894374:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788448325.894400:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788448325.894418:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788448325.894431:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788448325.894432:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788448325.895191:0:10335:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788448325.895388:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788448325.896175:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788448325.896195:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:0.0:1788448325.896210:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788448325.896212:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788448325.896975:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788448325.897505:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788448325.897554:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788448325.897571:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788448325.897586:0:10332:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788448325.897588:0:10332:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788448325.898293:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788448325.898485:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788448325.898510:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788448325.898532:0:10332:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:2.0:1788448325.898548:0:10332:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788448325.898574:0:10332:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898597:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898604:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898610:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898616:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898622:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898628:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898635:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898656:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898663:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898673:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898682:0:10332:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898690:0:10332:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898745:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.898764:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 9 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.898782:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826263680:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448325.899412:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.899425:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 9 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.899435:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826263808:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448325.899481:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.899490:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.899499:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826263936:0@lo:104: 00000100:00100000:2.0:1788448325.899544:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448325.899634:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.899642:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 23 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.899650:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264064:0@lo:104: 00000100:00100000:2.0:1788448325.899671:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448325.900911:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.900937:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.900948:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264192:0@lo:104: 00000100:00100000:2.0:1788448325.900994:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448325.901241:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826263936 00000100:00100000:1.0:1788448325.901251:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826263936 00000100:00100000:1.0:1788448325.901350:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264064 00000100:00100000:1.0:1788448325.901355:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264064 00000100:00100000:3.0:1788448325.901404:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448325.901418:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:10332:x1875323826263936:12345-0@lo:104: 00010000:00010000:3.0:1788448325.901450:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901533:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448325.901540:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:10332:x1875323826263936:12345-0@lo:104: Request processed in 126us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448325.901550:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448325.901575:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448325.901581:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:10332:x1875323826264064:12345-0@lo:104: 00010000:00010000:3.0:1788448325.901589:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901624:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788448325.901629:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:10332:x1875323826264064:12345-0@lo:104: Request processed in 49us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448325.901635:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1788448325.901654:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448325.901662:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901669:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.901674:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901683:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.901690:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.901704:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.901741:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901748:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.901771:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901778:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f200/0xf45a9e4e6b8036ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8036b4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.901793:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448325.901796:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.901957:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.901967:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.901991:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264448:0@lo:104: 00000100:00100000:2.0:1788448325.902025:0:10332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448325.902056:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.902063:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.902071:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264576:0@lo:104: 00010000:00010000:2.0:1788448325.902093:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.902100:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 23 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.902107:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264704:0@lo:104: 00010000:00010000:2.0:1788448325.902126:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.902134:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 23 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.902141:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264832:0@lo:104: 00010000:00010000:2.0:1788448325.902160:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.902168:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.902186:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264960:0@lo:104: 00010000:00010000:2.0:1788448325.902210:0:10332:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.902217:0:10332:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 23 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.902223:0:10332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826265088:0@lo:104: 00000100:00100000:2.0:1788448325.902238:0:10332:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448325.902260:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826263936:0@lo:104: 00000100:00100000:2.0:1788448325.902268:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264064:0@lo:104: 00010000:00010000:3.0:1788448325.902744:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181680000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.902750:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.902759:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.902766:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.902772:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.902796:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.902870:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.902914:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.902921:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181680000/0xf45a9e4e6b803683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80368a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.902950:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448325.902952:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448325.902955:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448325.902965:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448325.902982:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826264320:0@lo:103: 00000100:00100000:3.0:1788448325.903029:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448325.903157:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826265216:0@lo:103: 00000100:00100000:2.0:1788448325.903205:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448325.903261:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265216 00000100:00100000:2.0:1788448325.903268:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265216 00010000:00010000:2.0:1788448325.903300:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 24 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.903328:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448325.903337:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826265216:12345-0@lo:103: 00010000:00010000:2.0:1788448325.903350:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448325.903357:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 24 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.903367:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 24 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.903393:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681400/0xf45a9e4e6b80368a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803683 expref: 24 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.903410:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448325.903447:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3648:x1875323826265216:12345-0@lo:103: Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448325.903454:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448325.903487:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826265216:0@lo:103: 00000100:00100000:3.0:1788448325.903683:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264320 00000100:00100000:3.0:1788448325.903687:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264320 00010000:00010000:3.0:1788448325.903703:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448325.903722:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448325.903729:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3647:x1875323826264320:12345-0@lo:103: 00010000:00010000:3.0:1788448325.903736:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448325.903740:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.903747:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.903758:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e400/0xf45a9e4e6b8036b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8036ad expref: 23 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.903767:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448325.903870:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3647:x1875323826264320:12345-0@lo:103: Request processed in 72us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448325.903877:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448325.903974:0:6500:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788448325.903993:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448325.904007:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448325.904016:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448325.904380:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448325.904393:0:6500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448325.904401:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264192 00000100:00100000:3.0:1788448325.904406:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264192 00000100:00100000:3.0:1788448325.904429:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264448 00000100:00100000:3.0:1788448325.904432:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264448 00000100:00100000:3.0:1788448325.904443:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264576 00000100:00100000:3.0:1788448325.904445:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264576 00000100:00100000:3.0:1788448325.904453:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264704 00000100:00100000:3.0:1788448325.904456:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264704 00000100:00100000:3.0:1788448325.904463:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264832 00000100:00100000:3.0:1788448325.904466:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264832 00000100:00100000:3.0:1788448325.904474:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826264960 00000100:00100000:3.0:1788448325.904477:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826264960 00000100:00100000:3.0:1788448325.904488:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265088 00000100:00100000:3.0:1788448325.904490:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265088 00000100:00100000:3.0:1788448325.904501:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448325.904509:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:10332:x1875323826264192:12345-0@lo:104: 00000100:00100000:1.0:1788448325.904686:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448325.904699:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:10332:x1875323826264448:12345-0@lo:104: 00010000:00010000:1.0:1788448325.904863:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.904965:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448325.904972:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+9:10332:x1875323826264448:12345-0@lo:104: Request processed in 278us (2946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448325.904979:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448325.905000:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448325.905007:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+8:10332:x1875323826264576:12345-0@lo:104: 00010000:00010000:1.0:1788448325.905015:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.905328:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.905706:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264448:0@lo:104: 00010000:00010000:1.0:1788448325.905788:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788448325.905794:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+8:10332:x1875323826264576:12345-0@lo:104: Request processed in 788us (1800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448325.905811:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448325.905830:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448325.905838:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+7:10332:x1875323826264704:12345-0@lo:104: 00010000:00010000:1.0:1788448325.905849:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.905919:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788448325.905935:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+7:10332:x1875323826264704:12345-0@lo:104: Request processed in 99us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448325.905941:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448325.905955:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448325.905962:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:10332:x1875323826264832:12345-0@lo:104: 00010000:00010000:1.0:1788448325.905984:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.906020:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788448325.906025:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:10332:x1875323826264832:12345-0@lo:104: Request processed in 64us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448325.906031:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448325.906057:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448325.906064:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:10332:x1875323826264960:12345-0@lo:104: 00010000:00010000:1.0:1788448325.906072:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.906100:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788448325.906104:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:10332:x1875323826264960:12345-0@lo:104: Request processed in 43us (1726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448325.906110:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448325.906121:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448325.906126:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:10332:x1875323826265088:12345-0@lo:104: 00010000:00010000:1.0:1788448325.906134:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.906156:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788448325.906159:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:10332:x1875323826265088:12345-0@lo:104: Request processed in 34us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448325.906165:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448325.906280:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264576:0@lo:104: 00000100:00100000:2.0:1788448325.906289:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264704:0@lo:104: 00000100:00100000:2.0:1788448325.906295:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264832:0@lo:104: 00000100:00100000:2.0:1788448325.906301:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264960:0@lo:104: 00000100:00100000:2.0:1788448325.906307:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826265088:0@lo:104: 00010000:00010000:3.0:1788448325.906496:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788448325.906503:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:10332:x1875323826264192:12345-0@lo:104: Request processed in 1995us (5508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448325.906510:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448325.906654:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826264192:0@lo:104: 00010000:00010000:3.0:1788448325.906721:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788448325.906727:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906735:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.906740:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906751:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.906760:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.906767:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.906855:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906862:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.906911:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906918:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc18152f800/0xf45a9e4e6b80363d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803644 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906945:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788448325.906948:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906955:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.906958:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.906972:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.906979:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.906983:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.906999:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907004:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.907009:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907015:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ea00/0xf45a9e4e6b803621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803628 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907025:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788448325.907028:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.907126:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826265344:0@lo:103: 00000100:00100000:2.0:1788448325.907176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448325.907220:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448325.907226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826265472:0@lo:103: 00000100:00100000:2.0:1788448325.907245:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448325.907291:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.907294:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907301:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.907307:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.907321:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.907336:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907343:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.907362:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907369:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80361a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907382:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788448325.907386:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907392:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.907395:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907401:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.907407:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.907412:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.907423:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907429:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.907442:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907447:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1ec00/0xf45a9e4e6b803605 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80360c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907456:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448325.907460:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907464:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.907467:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907473:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.907480:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.907485:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.907495:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907500:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.907509:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.907516:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1e000/0xf45a9e4e6b8035c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035cd expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.907639:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826265728:0@lo:103: 00000100:00100000:2.0:1788448325.907664:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448325.907682:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448325.907686:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826265600:0@lo:103: 00000100:00100000:2.0:1788448325.907712:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448325.907735:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265344 00000100:00100000:2.0:1788448325.907741:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265344 00010000:00010000:2.0:1788448325.907770:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 22 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.907788:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265472 00000100:00100000:2.0:1788448325.907791:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265472 00010000:00010000:2.0:1788448325.907810:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.907821:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265728 00000100:00100000:2.0:1788448325.907823:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265728 00010000:00010000:2.0:1788448325.907831:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 24 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.907840:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265600 00000100:00100000:2.0:1788448325.907842:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265600 00010000:00010000:2.0:1788448325.907850:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 25 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448325.907861:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448325.907868:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+25:3645:x1875323826265344:12345-0@lo:103: 00010000:00010000:2.0:1788448325.907901:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448325.907907:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 25 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.907918:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 25 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.907944:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80363d expref: 25 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.907966:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448325.907997:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826265344:12345-0@lo:103: Request processed in 129us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448325.908003:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448325.908021:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448325.908027:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3645:x1875323826265472:12345-0@lo:103: 00010000:00010000:2.0:1788448325.908176:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448325.908181:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908190:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908200:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b803628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803621 expref: 23 pid: 6510 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908209:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448325.908234:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3645:x1875323826265472:12345-0@lo:103: Request processed in 207us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448325.908241:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448325.908256:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448325.908261:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3648:x1875323826265728:12345-0@lo:103: 00010000:00010000:2.0:1788448325.908269:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448325.908274:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 21 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908282:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 21 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908299:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152f400/0xf45a9e4e6b80360c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803605 expref: 21 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908308:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448325.908337:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3648:x1875323826265728:12345-0@lo:103: Request processed in 76us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448325.908343:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448325.908356:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448325.908363:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3648:x1875323826265600:12345-0@lo:103: 00010000:00010000:2.0:1788448325.908370:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448325.908374:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 19 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908381:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 19 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908390:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b80361a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803613 expref: 19 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448325.908399:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448325.908420:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3648:x1875323826265600:12345-0@lo:103: Request processed in 58us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448325.908425:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448325.908458:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826265600:0@lo:103: 00000100:00100000:2.0:1788448325.908466:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826265728:0@lo:103: 00010000:00010000:3.0:1788448325.908674:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448325.908685:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908692:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181680200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.908695:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908703:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.908709:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.908715:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.908737:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908743:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.908752:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908759:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b80359c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035a3 expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908773:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448325.908776:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908782:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181680400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448325.908785:0:9523:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908868:0:9523:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448325.908874:0:9523:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448325.908900:0:9523:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448325.908915:0:9523:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908920:0:9523:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448325.908944:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908950:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181680400/0xf45a9e4e6b803667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80366e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.908965:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448325.908966:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448325.908968:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448325.908985:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826265984:0@lo:103: 00000100:00100000:3.0:1788448325.909025:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448325.909142:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448325.909152:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826266112:0@lo:103: 00000100:00100000:3.0:1788448325.909273:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448325.909279:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826265856:0@lo:103: 00000100:00100000:3.0:1788448325.909300:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448325.909327:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265984 00000100:00100000:3.0:1788448325.909333:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265984 00010000:00010000:3.0:1788448325.909358:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 18 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448325.909387:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826265856 00000100:00100000:3.0:1788448325.909390:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826265856 00010000:00010000:3.0:1788448325.909404:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 19 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448325.909417:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448325.909423:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3646:x1875323826265984:12345-0@lo:103: 00010000:00010000:3.0:1788448325.909433:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448325.909438:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 19 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.909448:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 19 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.909460:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9000/0xf45a9e4e6b8035a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80359c expref: 19 pid: 6511 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.909471:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448325.909502:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:3646:x1875323826265984:12345-0@lo:103: Request processed in 79us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448325.909508:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448325.909607:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448325.909615:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:3646:x1875323826265856:12345-0@lo:103: 00010000:00010000:3.0:1788448325.909622:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448325.909626:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 17 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.909634:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 17 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.909650:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e200/0xf45a9e4e6b8035cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8035c6 expref: 17 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448325.909659:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448325.909682:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3646:x1875323826265856:12345-0@lo:103: Request processed in 69us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448325.909689:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448325.909722:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826265472:0@lo:103: 00000100:00100000:3.0:1788448325.909733:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826265344:0@lo:103: 00000100:00100000:3.0:1788448325.909760:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826265856:0@lo:103: 00000100:00100000:3.0:1788448325.909767:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826265984:0@lo:103: 00000100:00100000:3.0:1788448325.909794:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826264320:0@lo:103: 00010000:00010000:3.0:1788448325.909906:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448325.910545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448325.910649:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448325.910686:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047680 00000100:00100000:0.0:1788448325.910692:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047680 00010000:00010000:0.0:1788448325.910722:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 10 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448325.910745:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047808 00000100:00100000:0.0:1788448325.910749:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047808 00010000:00010000:0.0:1788448325.910760:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 11 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448325.910774:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1788448325.910781:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2400:x1875323801047680:12345-192.168.206.21@tcp:103: 00010000:00010000:0.0:1788448325.910792:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448325.910797:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 11 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.910815:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 11 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.910832:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448325.910904:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2400:x1875323801047680:12345-192.168.206.21@tcp:103: Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448325.910911:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1788448325.910955:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1788448325.910962:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801047808:12345-192.168.206.21@tcp:103: 00010000:00010000:0.0:1788448325.910970:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448325.910975:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 10 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.910986:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 10 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.910996:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448325.911014:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801047808:12345-192.168.206.21@tcp:103: Request processed in 53us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448325.911020:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00010000:00010000:3.0:1788448325.911784:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8036c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e045d expref: 9 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448325.911815:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826263680:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448325.911829:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8036c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0456 expref: 8 pid: 6509 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448325.911838:0:10332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10332:1875323826263808:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448325.911934:0:10332:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912131:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448325.912251:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448325.912460:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448325.912513:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266112 00000100:00100000:0.0:1788448325.912588:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266112 00010000:00010000:0.0:1788448325.912623:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 16 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448325.912690:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448325.912701:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:3648:x1875323826266112:12345-0@lo:103: 00010000:00010000:0.0:1788448325.912714:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448325.912720:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 16 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912730:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 16 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912747:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b80366e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803667 expref: 16 pid: 6509 timeout: 393 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912772:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912781:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912796:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912871:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912905:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912914:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912919:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448325.912940:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912949:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912969:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448325.912980:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448325.913157:0:10332:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.913171:0:10332:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448325.913177:0:10332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681200/0xf45a9e4e6b803708 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448325.915167:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:3648:x1875323826266112:12345-0@lo:103: Request processed in 2457us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448325.915196:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448325.915701:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826266112:0@lo:103: 00000100:00100000:0.0:1788448326.335663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826266240:0@lo:400: 00000100:00100000:0.0:1788448326.335763:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448326.335845:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826266752:0@lo:400: 00000100:00100000:0.0:1788448326.335868:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448326.335946:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826267264:0@lo:400: 00000100:00100000:0.0:1788448326.335980:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448326.336013:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788448326.336019:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826266624:0@lo:400: 00000100:00100000:0.0:1788448326.336045:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448326.336066:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826267136:0@lo:400: 00000100:00100000:0.0:1788448326.336089:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448326.336107:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826267648:0@lo:400: 00000100:00100000:0.0:1788448326.336159:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448326.336206:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266240 00000100:00100000:0.0:1788448326.336215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266240 00000100:00100000:0.0:1788448326.336269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266752 00000100:00100000:0.0:1788448326.336272:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266752 00000100:00100000:0.0:1788448326.336304:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267264 00000100:00100000:0.0:1788448326.336307:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267264 00000100:00100000:0.0:1788448326.336327:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448326.336337:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826266240:12345-0@lo:400: 00000100:00100000:0.0:1788448326.336405:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826266240:12345-0@lo:400: Request processed in 68us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.336427:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448326.336450:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788448326.336457:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826266752:12345-0@lo:400: 00000100:00100000:0.0:1788448326.336484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826266752:12345-0@lo:400: Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.336490:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788448326.336502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448326.336508:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826267264:12345-0@lo:400: 00000100:00100000:0.0:1788448326.336530:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826267264:12345-0@lo:400: Request processed in 23us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.336535:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448326.336560:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266624 00000100:00100000:0.0:1788448326.336563:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266624 00000100:00100000:0.0:1788448326.336591:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448326.336598:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826266624:12345-0@lo:400: 00000100:00100000:0.0:1788448326.336630:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826266624:12345-0@lo:400: Request processed in 33us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.336636:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448326.336657:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267136 00000100:00100000:0.0:1788448326.336661:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267136 00000100:00100000:0.0:1788448326.336690:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267648 00000100:00100000:0.0:1788448326.336693:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267648 00000100:00100000:0.0:1788448326.336712:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448326.336718:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826267136:12345-0@lo:400: 00000100:00100000:0.0:1788448326.336762:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826267136:12345-0@lo:400: Request processed in 43us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.336776:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448326.336789:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448326.336795:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826267648:12345-0@lo:400: 00000100:00100000:0.0:1788448326.336823:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826267648:12345-0@lo:400: Request processed in 29us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.336828:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788448326.336849:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448326.336853:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448326.336855:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448326.336942:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826266624:0@lo:400: 00010000:00080000:0.0:1788448326.336959:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cb100 x1875323826267136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448326.336970:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826267136:0@lo:400: 00010000:00080000:0.0:1788448326.336979:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cbb80 x1875323826267648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448326.336993:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826267648:0@lo:400: 00000100:00100000:0.0:1788448326.337006:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826266240:0@lo:400: 00000100:00100000:0.0:1788448326.337015:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826266752:0@lo:400: 00000100:00100000:0.0:1788448326.337025:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826267264:0@lo:400: 00000100:00100000:3.0:1788448326.337418:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826266496:0@lo:400: 00000100:00100000:3.0:1788448326.337476:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448326.337524:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826267008:0@lo:400: 00000100:00100000:3.0:1788448326.337558:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448326.337578:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826267520:0@lo:400: 00000100:00100000:3.0:1788448326.337599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448326.337631:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788448326.337639:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826266368:0@lo:400: 00000100:00100000:3.0:1788448326.337664:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448326.337679:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826266880:0@lo:400: 00000100:00100000:3.0:1788448326.337699:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448326.337714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826267392:0@lo:400: 00000100:00100000:3.0:1788448326.337739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448326.337763:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266496 00000100:00100000:3.0:1788448326.337770:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266496 00000100:00100000:3.0:1788448326.337799:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266880 00000100:00100000:3.0:1788448326.337802:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266880 00000100:00100000:3.0:1788448326.337825:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267392 00000100:00100000:3.0:1788448326.337829:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267392 00000100:00100000:3.0:1788448326.337843:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448326.337851:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826266496:12345-0@lo:400: 00000100:00100000:3.0:1788448326.337942:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826266496:12345-0@lo:400: Request processed in 92us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448326.337949:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448326.341192:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448326.341232:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826266880:12345-0@lo:400: 00000100:00100000:3.0:1788448326.341354:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826266880:12345-0@lo:400: Request processed in 145us (3653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448326.341379:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448326.341415:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788448326.341422:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826267392:12345-0@lo:400: 00000100:00100000:3.0:1788448326.341452:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826267392:12345-0@lo:400: Request processed in 31us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448326.341458:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788448326.341492:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267008 00000100:00100000:3.0:1788448326.341500:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267008 00000100:00100000:3.0:1788448326.341549:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267520 00000100:00100000:3.0:1788448326.341552:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267520 00000100:00100000:3.0:1788448326.341571:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448326.341577:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826267008:12345-0@lo:400: 00000100:00100000:3.0:1788448326.341605:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826267008:12345-0@lo:400: Request processed in 29us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448326.341611:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448326.341621:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448326.341627:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826267520:12345-0@lo:400: 00000100:00100000:3.0:1788448326.341651:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826267520:12345-0@lo:400: Request processed in 25us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448326.341656:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788448326.341671:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448326.341675:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448326.341678:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788448326.341720:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cad80 x1875323826266880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448326.341737:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826266880:0@lo:400: 00010000:00080000:3.0:1788448326.341761:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7c8380 x1875323826267392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448326.341771:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826267392:0@lo:400: 00000100:00100000:3.0:1788448326.341785:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826266496:0@lo:400: 00010000:00080000:3.0:1788448326.341796:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7ca680 x1875323826267008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448326.341805:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826267008:0@lo:400: 00010000:00080000:3.0:1788448326.341815:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7ca300 x1875323826267520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448326.341823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826267520:0@lo:400: 00000100:00100000:0.0:1788448326.343009:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826266368 00000100:00100000:0.0:1788448326.343025:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826266368 00000100:00100000:0.0:1788448326.343101:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448326.343114:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826266368:12345-0@lo:400: 00000100:00100000:0.0:1788448326.343234:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826266368:12345-0@lo:400: Request processed in 123us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448326.343242:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448326.343486:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826266368:0@lo:400: 00010000:00010000:3.0:1788448326.654203:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448326.848732:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448326.848762:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826267776:0@lo:13: 00000100:00100000:2.0:1788448326.848853:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448326.849505:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267776 00000100:00100000:1.0:1788448326.849517:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267776 00000100:00100000:1.0:1788448326.849581:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448326.849593:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826267776:12345-0@lo:13: 00002000:00000024:1.0:1788448326.849627:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448326.849682:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826267776:12345-0@lo:13: Request processed in 92us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448326.849689:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448326.849810:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826267904:0@lo:13: 00000100:00100000:2.0:1788448326.849845:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788448326.849956:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9880 x1875323826267776/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448326.849979:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826267776:0@lo:13: 00000100:00100000:1.0:1788448326.850568:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826267904 00000100:00100000:1.0:1788448326.850575:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826267904 00000100:00100000:1.0:1788448326.850656:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448326.850665:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826267904:12345-0@lo:13: 00002000:00000024:1.0:1788448326.850683:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448326.850735:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826267904:12345-0@lo:13: Request processed in 71us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448326.850742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788448326.850803:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb577480 x1875323826267904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448326.850817:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb577480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826267904:0@lo:13: 00000100:00100000:3.0:1788448327.358352:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826268032:0@lo:41: 00000100:00100000:3.0:1788448327.358468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.358703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268032 00000100:00100000:1.0:1788448327.358714:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268032 00000100:00100000:1.0:1788448327.358789:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448327.358802:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826268032:12345-0@lo:41: 00000004:00000024:1.0:1788448327.358909:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448327.359235:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826268032:12345-0@lo:41: Request processed in 435us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.359243:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788448327.359750:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826268032:0@lo:41: 00000100:00100000:0.0:1788448327.530062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448327.530116:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448327.530155:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448327.530183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448327.530208:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448327.530299:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048448 00000100:00100000:2.0:1788448327.530311:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048448 00000100:00100000:2.0:1788448327.530386:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048320 00000100:00100000:2.0:1788448327.530389:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048320 00000100:00100000:2.0:1788448327.530415:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:2.0:1788448327.530425:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801048448:12345-192.168.206.21@tcp:400: 00000100:00100000:2.0:1788448327.530519:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801048448:12345-192.168.206.21@tcp:400: Request processed in 95us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.530527:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:2.0:1788448327.530547:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1788448327.530553:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801048320:12345-192.168.206.21@tcp:400: 00000100:00100000:2.0:1788448327.530577:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801048320:12345-192.168.206.21@tcp:400: Request processed in 24us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.530604:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448327.531235:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801047936 00000100:00100000:3.0:1788448327.531245:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801047936 00000100:00100000:3.0:1788448327.531298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:3.0:1788448327.531307:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:2398:x1875323801047936:12345-192.168.206.21@tcp:400: 00000100:00100000:3.0:1788448327.531359:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:2398:x1875323801047936:12345-192.168.206.21@tcp:400: Request processed in 53us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.531366:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:1.0:1788448327.531706:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048192 00000100:00100000:1.0:1788448327.531713:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048192 00000100:00100000:1.0:1788448327.531758:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048064 00000100:00100000:1.0:1788448327.531762:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048064 00000100:00100000:1.0:1788448327.531805:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1788448327.531815:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801048192:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1788448327.531869:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801048192:12345-192.168.206.21@tcp:400: Request processed in 56us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.531876:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1788448327.531935:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:1.0:1788448327.531943:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801048064:12345-192.168.206.21@tcp:400: 00000100:00100000:1.0:1788448327.531969:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801048064:12345-192.168.206.21@tcp:400: Request processed in 27us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.531975:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00080000:0.0:1788448327.532197:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448327.532203:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448327.532206:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448327.532208:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1788448327.613987:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788448327.613998:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1bf749000 from 48 10000000:01000000:0.0:1788448327.614006:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448327.614074:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.614087:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.614101:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448327.614131:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268160:0@lo:101: 00000100:00100000:0.0:1788448327.614227:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.614321:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb431000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.614630:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268160 00000100:00100000:1.0:1788448327.614641:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268160 00000100:00100000:1.0:1788448327.614708:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788448327.614719:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+15:6514:x1875323826268160:12345-0@lo:101: 00010000:00010000:1.0:1788448327.614734:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448327.614752:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b803716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80370f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.614782:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b803716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80370f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.614818:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b803716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80370f expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.614829:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8800, rc 0) 00000100:00100000:1.0:1788448327.614934:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826268160:12345-0@lo:101: Request processed in 217us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.614941:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788448327.615066:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268160:0@lo:101: 00010000:00010000:0.0:1788448327.615085:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.615102:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448327.615180:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268288:0@lo:501: 00000100:00100000:0.0:1788448327.615216:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.615251:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb431000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.615448:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268288 00000100:00100000:2.0:1788448327.615455:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268288 00000100:00100000:2.0:1788448327.615481:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788448327.615488:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826268288:12345-0@lo:501: 00000100:00100000:2.0:1788448327.615627:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826268288:12345-0@lo:501: Request processed in 139us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.615635:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788448327.615863:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268288:0@lo:501: 00000100:00100000:0.0:1788448327.615932:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268416:0@lo:503: 00000100:00100000:0.0:1788448327.615991:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.616021:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb431000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.616071:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268416 00000100:00100000:2.0:1788448327.616076:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268416 00000100:00100000:2.0:1788448327.616108:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788448327.616116:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826268416:12345-0@lo:503: 00000100:00100000:2.0:1788448327.616209:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826268416:12345-0@lo:503: Request processed in 93us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.616216:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788448327.616344:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268416:0@lo:503: 00000100:00100000:0.0:1788448327.617799:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10349:1875323826268544:0@lo:502: 00000100:00100000:0.0:1788448327.617878:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.617976:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb431a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.618048:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268544 00000100:00100000:1.0:1788448327.618056:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268544 00000100:00100000:1.0:1788448327.618109:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788448327.618120:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:10349:x1875323826268544:12345-0@lo:502: 00000100:00100000:1.0:1788448327.618275:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:10349:x1875323826268544:12345-0@lo:502: Request processed in 156us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.618284:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788448327.618609:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10349:1875323826268544:0@lo:502: 00000100:00100000:0.0:1788448327.618662:0:10349:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10349:1875323826268672:0@lo:502: 00000100:00100000:0.0:1788448327.618699:0:10349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.618726:0:10349:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb431a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.618794:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268672 00000100:00100000:3.0:1788448327.618808:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268672 00000100:00100000:3.0:1788448327.618845:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788448327.618853:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:10349:x1875323826268672:12345-0@lo:502: 00000100:00100000:3.0:1788448327.619006:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:10349:x1875323826268672:12345-0@lo:502: Request processed in 154us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.619014:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788448327.619174:0:10349:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10349:1875323826268672:0@lo:502: 00000040:00080000:0.0:1788448327.619193:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788448327.619472:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788448327.619497:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448327.619509:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.619522:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448327.619532:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788448327.619535:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788448327.619538:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788448327.619566:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.619581:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.619592:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.619605:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268800:0@lo:101: 00000100:00100000:2.0:1788448327.619641:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.619676:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.619731:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268800 00000100:00100000:1.0:1788448327.619736:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268800 00000100:00100000:1.0:1788448327.619770:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788448327.619778:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+16:6514:x1875323826268800:12345-0@lo:101: 00010000:00010000:1.0:1788448327.619789:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448327.619805:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9600/0xf45a9e4e6b803724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80371d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.619831:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9600/0xf45a9e4e6b803724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80371d expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.619842:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9600/0xf45a9e4e6b803724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80371d expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.619864:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9600, rc 0) 00000100:00100000:1.0:1788448327.619946:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826268800:12345-0@lo:101: Request processed in 167us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.619952:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788448327.620102:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268800:0@lo:101: 00010000:00010000:2.0:1788448327.620116:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.620125:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.620182:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268928:0@lo:501: 00000100:00100000:2.0:1788448327.620212:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.620240:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.620286:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826268928 00000100:00100000:3.0:1788448327.620291:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826268928 00000100:00100000:3.0:1788448327.620329:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788448327.620337:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826268928:12345-0@lo:501: 00000100:00100000:3.0:1788448327.620473:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826268928:12345-0@lo:501: Request processed in 136us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.620479:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788448327.620803:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826268928:0@lo:501: 00000100:00100000:2.0:1788448327.620836:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269056:0@lo:503: 00000100:00100000:2.0:1788448327.620934:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.620956:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.621484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269056 00000100:00100000:3.0:1788448327.621492:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269056 00000100:00100000:3.0:1788448327.621530:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788448327.621539:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826269056:12345-0@lo:503: 00000100:00100000:3.0:1788448327.621667:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826269056:12345-0@lo:503: Request processed in 128us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.621673:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788448327.621995:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269056:0@lo:503: 00000100:00100000:1.0:1788448327.622399:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10350:1875323826269184:0@lo:502: 00000100:00100000:1.0:1788448327.622453:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.622494:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.624549:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269184 00000100:00100000:2.0:1788448327.624586:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269184 00000100:00100000:2.0:1788448327.624668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788448327.624681:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:10350:x1875323826269184:12345-0@lo:502: 00000100:00100000:2.0:1788448327.624956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:10350:x1875323826269184:12345-0@lo:502: Request processed in 204us (2429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.624965:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788448327.626183:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10350:1875323826269184:0@lo:502: 00000020:01000000:1.0:1788448327.626239:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448327.626254:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448327.626257:0:10350:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448327.626263:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788448327.626310:0:10350:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10350:1875323826269312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448327.626418:0:10350:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.626475:0:10350:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.626785:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269312 00000100:00100000:2.0:1788448327.626794:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269312 00000100:00100000:2.0:1788448327.626853:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788448327.626864:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:10350:x1875323826269312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.627061:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:10350:x1875323826269312:12345-0@lo:502:llog_process_th.0 Request processed in 198us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.627069:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788448327.629019:0:10350:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10350:1875323826269312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448327.629082:0:10350:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448327.629095:0:10350:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448327.629098:0:10350:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448327.629103:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788448327.629338:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788448327.629367:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788448327.629390:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.629404:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448327.629416:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788448327.629419:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1ba23b000 from 48 10000000:01000000:2.0:1788448327.629423:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448327.629468:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.629477:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.629507:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.629532:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.629604:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.629657:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.629940:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269440 00000100:00100000:3.0:1788448327.629949:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269440 00000100:00100000:3.0:1788448327.630007:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788448327.630019:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+17:6514:x1875323826269440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448327.630034:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448327.630050:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b803732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80372b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.630093:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b803732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80372b expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.630104:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b803732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80372b expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.630115:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204be00, rc 0) 00000100:00100000:3.0:1788448327.630162:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826269440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.630170:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788448327.630365:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448327.630390:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.630400:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448327.630471:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.630503:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.630517:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.630648:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269568 00000100:00100000:3.0:1788448327.630653:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269568 00000100:00100000:3.0:1788448327.630685:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1788448327.630691:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826269568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.630831:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826269568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.630838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788448327.632077:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.632135:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.632206:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.632252:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.632482:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269696 00000100:00100000:3.0:1788448327.632490:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269696 00000100:00100000:3.0:1788448327.632538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788448327.632548:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826269696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.632668:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826269696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.632675:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788448327.634548:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826269696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.635824:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10351:1875323826269824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.635972:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.636018:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.636124:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269824 00000100:00100000:1.0:1788448327.636131:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269824 00000100:00100000:1.0:1788448327.636179:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1788448327.636188:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:10351:x1875323826269824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448327.636341:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:10351:x1875323826269824:12345-0@lo:502:llog_process_th.0 Request processed in 153us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.636349:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788448327.636592:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10351:1875323826269824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.636646:0:10351:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10351:1875323826269952:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.636682:0:10351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.636714:0:10351:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.636786:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826269952 00000100:00100000:3.0:1788448327.636791:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826269952 00000100:00100000:3.0:1788448327.636836:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788448327.636843:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:10351:x1875323826269952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448327.636956:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:10351:x1875323826269952:12345-0@lo:502:llog_process_th.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.636964:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788448327.638404:0:10351:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10351:1875323826269952:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788448327.638461:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788448327.638730:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788448327.638756:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448327.638769:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.638782:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448327.638795:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788448327.638815:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788448327.638818:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788448327.638859:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.638868:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.638878:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448327.638948:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.639017:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.639062:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.639128:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270080 00000100:00100000:3.0:1788448327.639136:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270080 00000100:00100000:3.0:1788448327.639194:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788448327.639206:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+18:6514:x1875323826270080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448327.639220:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448327.639235:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204a600/0xf45a9e4e6b803740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803739 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.639263:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204a600/0xf45a9e4e6b803740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803739 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.639274:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204a600/0xf45a9e4e6b803740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803739 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.639283:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204a600, rc 0) 00000100:00100000:3.0:1788448327.639613:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826270080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 407us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.639620:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788448327.641199:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448327.641232:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.641246:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.641352:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.641560:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.641666:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.641703:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270208 00000100:00100000:1.0:1788448327.641711:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270208 00000100:00100000:1.0:1788448327.641812:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788448327.641824:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826270208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.642101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826270208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.642110:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788448327.642193:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.642228:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.642269:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.642752:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.642821:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270336 00000100:00100000:3.0:1788448327.642827:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270336 00000100:00100000:1.0:1788448327.642905:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788448327.642925:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826270336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.643033:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826270336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 119us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.643041:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:2.0:1788448327.643226:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.644241:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10352:1875323826270464:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.644311:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.644354:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.644462:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270464 00000100:00100000:3.0:1788448327.644471:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270464 00000100:00100000:3.0:1788448327.644554:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788448327.644565:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:10352:x1875323826270464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448327.644871:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:10352:x1875323826270464:12345-0@lo:502:llog_process_th.0 Request processed in 305us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.644904:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788448327.645589:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10352:1875323826270464:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448327.645631:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448327.645645:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448327.645648:0:10352:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788448327.645653:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788448327.645689:0:10352:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10352:1875323826270592:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.645748:0:10352:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.646070:0:10352:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.650577:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270592 00000100:00100000:1.0:1788448327.650597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270592 00000100:00100000:1.0:1788448327.651863:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788448327.652084:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:10352:x1875323826270592:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448327.652319:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:10352:x1875323826270592:12345-0@lo:502:llog_process_th.0 Request processed in 440us (6570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.652328:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788448327.652474:0:10352:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10352:1875323826270592:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448327.652519:0:10352:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448327.652528:0:10352:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448327.652531:0:10352:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788448327.652537:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788448327.652843:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788448327.652907:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788448327.652929:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.652943:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448327.652953:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788448327.652956:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc19ea22000 from 48 10000000:01000000:2.0:1788448327.652960:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448327.653013:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.653023:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.653033:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.653059:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.653112:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.654461:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270720 00000100:00100000:0.0:1788448327.654476:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270720 00000100:00100000:0.0:1788448327.654533:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788448327.654543:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:6514:x1875323826270720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448327.654574:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448327.654594:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351ee00/0xf45a9e4e6b80374e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803747 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.654624:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351ee00/0xf45a9e4e6b80374e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803747 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.654636:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351ee00/0xf45a9e4e6b80374e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803747 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.654645:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ee00, rc 0) 00000100:00100000:0.0:1788448327.654703:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826270720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.654710:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788448327.654790:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.654817:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448327.654836:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.654847:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.654968:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.655003:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.655025:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.655178:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270848 00000100:00100000:0.0:1788448327.655182:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270848 00000100:00100000:0.0:1788448327.655204:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788448327.655211:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826270848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.655361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826270848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 151us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.655369:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788448327.655512:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.655544:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.655595:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.655628:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.655730:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826270976 00000100:00100000:0.0:1788448327.655735:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826270976 00000100:00100000:0.0:1788448327.655760:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788448327.655766:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826270976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.656222:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826270976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 453us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.656241:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788448327.656595:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826270976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.657250:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10353:1875323826271104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448327.657315:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448327.657355:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.657468:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271104 00000100:00100000:0.0:1788448327.657475:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271104 00000100:00100000:0.0:1788448327.657520:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788448327.657530:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:10353:x1875323826271104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.657706:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:10353:x1875323826271104:12345-0@lo:502:llog_process_th.0 Request processed in 177us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.657714:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788448327.658141:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10353:1875323826271104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.658200:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10353:1875323826271232:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.658245:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.658311:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.658343:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271232 00000100:00100000:3.0:1788448327.658349:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271232 00000100:00100000:3.0:1788448327.658667:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788448327.658679:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:10353:x1875323826271232:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448327.658924:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:10353:x1875323826271232:12345-0@lo:502:llog_process_th.0 Request processed in 237us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.658932:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788448327.659133:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10353:1875323826271232:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788448327.659179:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788448327.662217:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788448327.662275:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448327.662291:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.662307:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448327.662535:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788448327.662540:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:2.0:1788448327.662543:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788448327.662600:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.662610:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.662624:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448327.662657:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826271360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448327.662743:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448327.662927:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.671127:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271360 00000100:00100000:1.0:1788448327.671151:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271360 00000100:00100000:2.0:1788448327.672903:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788448327.672955:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826271360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448327.672980:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448327.673005:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b80375c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803755 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.673068:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b80375c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803755 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.673082:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b80375c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803755 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448327.673093:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181680400, rc 0) 00000100:00100000:2.0:1788448327.673197:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826271360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 248us (10453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.673204:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788448327.673819:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826271360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448327.673846:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.673868:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448327.674004:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826271488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.674051:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448327.678105:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448327.678612:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271488 00000100:00100000:0.0:1788448327.678630:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271488 00000100:00100000:3.0:1788448327.678673:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.678702:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788448327.678717:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826271488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.679197:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826271488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 482us (5143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.679206:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788448327.679590:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826271488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.679656:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826271616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.679722:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.679764:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.679989:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271616 00000100:00100000:1.0:1788448327.679996:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271616 00000100:00100000:1.0:1788448327.680048:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788448327.680059:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826271616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.680181:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826271616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.680188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788448327.680279:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826271616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.683707:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10354:1875323826271744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.684748:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.685869:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082647d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.688254:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271744 00000100:00100000:1.0:1788448327.688276:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271744 00000100:00100000:2.0:1788448327.688686:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788448327.688701:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10354:x1875323826271744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.689165:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10354:x1875323826271744:12345-0@lo:502:llog_process_th.0 Request processed in 464us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.689175:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788448327.690676:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10354:1875323826271744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448327.690738:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448327.690755:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448327.690757:0:10354:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788448327.690766:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788448327.690823:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10354:1875323826271872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.691072:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.691205:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082647d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.692952:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826271872 00000100:00100000:2.0:1788448327.692970:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826271872 00000100:00100000:2.0:1788448327.693100:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788448327.693114:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10354:x1875323826271872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.693348:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10354:x1875323826271872:12345-0@lo:502:llog_process_th.0 Request processed in 235us (2276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.693357:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788448327.693487:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10354:1875323826271872:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448327.693528:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448327.693538:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448327.693541:0:10354:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448327.693546:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:3.0:1788448327.693832:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:3.0:1788448327.693927:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788448327.693940:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.693952:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448327.693965:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788448327.693968:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc190ac6000 from 48 10000000:01000000:3.0:1788448327.693971:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448327.694008:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.694017:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.694027:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448327.694051:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.694099:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.694634:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.694739:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272000 00000100:00100000:0.0:1788448327.694747:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272000 00000100:00100000:0.0:1788448327.694795:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788448327.694805:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826272000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448327.694819:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448327.694838:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b80376a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803763 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.694877:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b80376a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803763 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.694909:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b80376a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803763 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.694930:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fa00, rc 0) 00000100:00100000:0.0:1788448327.694980:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826272000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.694987:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788448327.695091:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448327.695110:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.695120:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448327.695192:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.695222:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.695242:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.695356:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272128 00000100:00100000:0.0:1788448327.695361:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272128 00000100:00100000:0.0:1788448327.695495:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788448327.695503:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826272128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.695629:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826272128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.695638:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788448327.695707:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.695737:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.695786:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.695818:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.697244:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272256 00000100:00100000:0.0:1788448327.697258:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272256 00000100:00100000:0.0:1788448327.697311:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788448327.697349:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826272256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.697627:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826272256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.697636:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788448327.697771:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.698706:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10355:1875323826272384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448327.698780:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.698824:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.699080:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272384 00000100:00100000:0.0:1788448327.699087:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272384 00000100:00100000:0.0:1788448327.699122:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788448327.699131:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10355:x1875323826272384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.699262:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10355:x1875323826272384:12345-0@lo:502:llog_process_th.0 Request processed in 132us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.699270:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788448327.700707:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10355:1875323826272384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448327.700806:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10355:1875323826272512:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448327.700942:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.700984:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1a1566a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448327.701131:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272512 00000100:00100000:0.0:1788448327.701139:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272512 00000100:00100000:0.0:1788448327.701185:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788448327.701196:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10355:x1875323826272512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.701342:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10355:x1875323826272512:12345-0@lo:502:llog_process_th.0 Request processed in 147us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448327.701350:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788448327.701664:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10355:1875323826272512:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788448327.701692:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788448327.702007:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788448327.702059:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448327.702072:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.702085:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448327.702096:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788448327.702106:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1788448327.702110:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788448327.702145:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.702154:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.702165:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448327.702185:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.702231:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.702274:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.702354:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272640 00000100:00100000:3.0:1788448327.702360:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272640 00000100:00100000:3.0:1788448327.702399:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788448327.702408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826272640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448327.702420:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448327.702435:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204ae00/0xf45a9e4e6b803778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803771 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.702462:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204ae00/0xf45a9e4e6b803778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803771 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.702473:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204ae00/0xf45a9e4e6b803778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803771 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448327.702482:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204ae00, rc 0) 00000100:00100000:3.0:1788448327.702524:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826272640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.702530:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788448327.702702:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448327.702716:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.702725:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448327.702778:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.702806:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.702825:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d236c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448327.703342:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272768 00000100:00100000:3.0:1788448327.703347:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272768 00000100:00100000:3.0:1788448327.703373:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788448327.703539:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826272768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.703789:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826272768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 408us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448327.703797:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788448327.704192:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.704243:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.704304:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.704469:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d236c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.704536:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826272896 00000100:00100000:1.0:1788448327.704543:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826272896 00000100:00100000:1.0:1788448327.704635:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788448327.704645:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826272896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.704768:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826272896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.704786:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788448327.704925:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826272896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.705205:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10356:1875323826273024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.705245:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.710132:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.710241:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273024 00000100:00100000:2.0:1788448327.710253:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273024 00000100:00100000:2.0:1788448327.710440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788448327.710455:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10356:x1875323826273024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.710727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10356:x1875323826273024:12345-0@lo:502:llog_process_th.0 Request processed in 276us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.710736:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788448327.710841:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10356:1875323826273024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448327.711042:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448327.711054:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448327.711057:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788448327.711064:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788448327.711105:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10356:1875323826273152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448327.711155:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.711231:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.711268:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273152 00000100:00100000:2.0:1788448327.711273:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273152 00000100:00100000:2.0:1788448327.711300:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788448327.711306:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10356:x1875323826273152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448327.711551:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10356:x1875323826273152:12345-0@lo:502:llog_process_th.0 Request processed in 244us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448327.711559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788448327.711634:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10356:1875323826273152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448327.711654:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448327.711658:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448327.711660:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788448327.711664:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788448327.712590:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788448327.712630:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788448327.712656:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.712671:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448327.712684:0:6514:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788448327.712687:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc19ebe99b8 from 1 10000000:01000000:1.0:1788448327.712690:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788448327.712730:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.712740:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.712751:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448327.712790:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826273280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448327.712852:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448327.712879:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273280 00000100:00100000:3.0:1788448327.712903:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273280 00000100:00100000:1.0:1788448327.712934:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448327.712974:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788448327.712985:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826273280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448327.713000:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448327.713016:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b803786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b80377f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.713042:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b803786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b80377f expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.713054:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b803786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80377f expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448327.713064:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8c00, rc 0) 00000100:00100000:1.0:1788448327.713110:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826273280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448327.713119:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788448327.713139:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826273280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448327.713158:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.713170:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448327.713231:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826273408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448327.713258:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448327.714223:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448327.716059:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273408 00000100:00100000:2.0:1788448327.716076:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273408 00000100:00100000:3.0:1788448327.717056:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788448327.717077:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826273408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448327.717275:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826273408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (4014us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448327.717284:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788448327.717553:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826273408:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788448327.717629:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788448327.717641:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448327.717654:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448328.702145:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448328.869663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448328.869759:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048576 00000100:00100000:1.0:1788448328.869776:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048576 00000100:00100000:1.0:1788448328.869998:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:1.0:1788448328.870017:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:6171:x1875323801048576:12345-192.168.206.21@tcp:101: 00010000:00010000:1.0:1788448328.870040:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448328.870062:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8400/0xf45a9e4e6b80378d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e04cd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448328.870123:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8400/0xf45a9e4e6b80378d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04cd expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448328.870135:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8400/0xf45a9e4e6b80378d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04cd expref: 9 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448328.870145:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8400, rc 0) 00000100:00100000:1.0:1788448328.870379:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801048576:12345-192.168.206.21@tcp:101: Request processed in 365us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448328.870387:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:0.0:1788448328.880333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448328.880471:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048704 00000100:00100000:2.0:1788448328.880485:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048704 00000100:00100000:2.0:1788448328.880552:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 243 00000100:00100000:2.0:1788448328.880563:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801048704:12345-192.168.206.21@tcp:501: 00000100:00100000:2.0:1788448328.881022:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801048704:12345-192.168.206.21@tcp:501: Request processed in 457us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448328.881032:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 243 00000100:00100000:0.0:1788448328.890964:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448328.891383:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048832 00000100:00100000:3.0:1788448328.891397:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048832 00000100:00100000:3.0:1788448328.891476:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:3.0:1788448328.891490:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801048832:12345-192.168.206.21@tcp:503: 00000100:00100000:3.0:1788448328.891684:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801048832:12345-192.168.206.21@tcp:503: Request processed in 197us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448328.891694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:3.0:1788448328.896737:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448328.896871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801048960 00000100:00100000:2.0:1788448328.896931:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801048960 00000100:00100000:2.0:1788448328.897004:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:2.0:1788448328.897018:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6657:x1875323801048960:12345-192.168.206.21@tcp:502: 00000100:00100000:2.0:1788448328.897229:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6657:x1875323801048960:12345-192.168.206.21@tcp:502: Request processed in 213us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448328.897238:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:0.0:1788448328.900652:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448328.900773:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049088 00000100:00100000:1.0:1788448328.900787:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049088 00000100:00100000:1.0:1788448328.900859:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 246 00000100:00100000:1.0:1788448328.900872:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6657:x1875323801049088:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448328.901124:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6657:x1875323801049088:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 254us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448328.901133:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 246 00000100:00100000:0.0:1788448328.907083:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448328.910871:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049216 00000100:00100000:3.0:1788448328.911438:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049216 00000100:00100000:3.0:1788448328.911533:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:3.0:1788448328.911546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801049216:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448328.911571:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448328.911596:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204a400/0xf45a9e4e6b803794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e04d4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448328.912017:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204a400/0xf45a9e4e6b803794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04d4 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448328.912033:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204a400/0xf45a9e4e6b803794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04d4 expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448328.912046:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204a400, rc 0) 00000100:00100000:3.0:1788448328.914142:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049216:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 2581us (7056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448328.914158:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:3.0:1788448328.922497:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448328.925977:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049344 00000100:00100000:2.0:1788448328.925999:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049344 00000100:00100000:2.0:1788448328.926094:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 248 00000100:00100000:2.0:1788448328.926106:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049344:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448328.926289:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049344:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 176us (3797us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788448328.926299:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 248 00000100:00100000:0.0:1788448329.406170:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448329.406196:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826273536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448329.406283:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448329.406353:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448329.406385:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273536 00000100:00100000:2.0:1788448329.406388:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826273664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448329.406396:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273536 00000100:00100000:0.0:1788448329.406462:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448329.406469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448329.406482:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826273536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448329.406523:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448329.406526:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273664 00000100:00100000:2.0:1788448329.406534:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273664 00000100:00100000:2.0:1788448329.406592:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788448329.406599:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826273536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448329.406607:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826273664:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448329.406616:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788448329.406647:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00000024:2.0:1788448329.406654:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00010000:00080000:0.0:1788448329.406686:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cf800 x1875323826273536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448329.406718:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826273664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448329.406743:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788448329.406765:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826273536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448329.406812:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826273664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448329.407012:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826273792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448329.407052:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448329.407223:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826273792 00000100:00100000:3.0:1788448329.407229:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826273792 00000100:00100000:3.0:1788448329.407262:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448329.407269:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826273792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448329.407283:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448329.407319:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826273792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448329.407325:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788448329.407348:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448329.407372:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cf800 x1875323826273792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448329.407387:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826273792:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788448329.726454:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448330.282731:0:10393:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd10ffd5d0 20000000:00000080:0.0:1788448330.282749:0:10393:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc1bf7e3400 uarg=0000000000000000 20000000:01000000:0.0:1788448330.282789:0:10393:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448330.282795:0:10393:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448330.282799:0:10393:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788448330.283693:0:10394:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788448330.284098:0:10393:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788448330.291376:0:10393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788448330.291414:0:10393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788448330.291432:0:10393:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788448330.291449:0:10393:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788448330.291469:0:10393:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291487:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291510:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291518:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291540:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291549:0:10393:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291557:0:10393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291597:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.291623:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 9 pid: 6511 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448330.291638:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826273920:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448330.292541:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.292555:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 23 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448330.292567:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274048:0@lo:104: 00000100:00100000:1.0:1788448330.292716:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448330.292755:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.292764:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448330.292773:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274176:0@lo:104: 00000100:00100000:1.0:1788448330.292917:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448330.292954:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.292963:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448330.292972:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274304:0@lo:104: 00010000:00010000:1.0:1788448330.293153:0:10393:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448330.293162:0:10393:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 23 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448330.293170:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274432:0@lo:104: 00000100:00100000:1.0:1788448330.293189:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448330.293271:0:9521:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788448330.293291:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448330.293323:0:9521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448330.293332:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274048 00000100:00100000:2.0:1788448330.293339:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274048 00000100:00100000:2.0:1788448330.293375:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274176 00000100:00100000:2.0:1788448330.293378:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274176 00000100:00100000:2.0:1788448330.293389:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274304 00000100:00100000:2.0:1788448330.293399:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274304 00000100:00100000:2.0:1788448330.293413:0:9521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274432 00000100:00100000:2.0:1788448330.293415:0:9521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274432 00000100:00100000:2.0:1788448330.293428:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448330.293437:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:10393:x1875323826274048:12345-0@lo:104: 00010000:00010000:2.0:1788448330.293449:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.293496:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448330.293502:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:10393:x1875323826274048:12345-0@lo:104: Request processed in 67us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.293509:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448330.293523:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448330.293529:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb570050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:10393:x1875323826274176:12345-0@lo:104: 00010000:00010000:2.0:1788448330.293536:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.293569:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448330.293575:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb570050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:10393:x1875323826274176:12345-0@lo:104: Request processed in 46us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.293581:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448330.293625:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448330.293632:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:10393:x1875323826274304:12345-0@lo:104: 00010000:00010000:2.0:1788448330.293640:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.293674:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788448330.293679:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:10393:x1875323826274304:12345-0@lo:104: Request processed in 49us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.293692:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448330.293721:0:9521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448330.293728:0:9521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:10393:x1875323826274432:12345-0@lo:104: 00010000:00010000:2.0:1788448330.293735:0:9521:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.293770:0:9521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788448330.294004:0:9521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:10393:x1875323826274432:12345-0@lo:104: Request processed in 49us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.294013:0:9521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:2.0:1788448330.294033:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448330.294039:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294046:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448330.294050:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294059:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448330.294066:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448330.294073:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448330.294103:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294108:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448330.294133:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294140:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1fa00/0xf45a9e4e6b8035b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8035bf expref: -99 pid: 9510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294154:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448330.294157:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294162:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030a00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448330.294165:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294171:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448330.294176:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448330.294181:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448330.294195:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294200:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448330.294214:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294221:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180030a00/0xf45a9e4e6b803492 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803499 expref: -99 pid: 8425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294230:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448330.294240:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294246:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ba00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448330.294248:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294255:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448330.294261:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448330.294266:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448330.294280:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294286:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448330.294293:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294300:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204ba00/0xf45a9e4e6b80343e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803445 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294310:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448330.294313:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294319:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448330.294322:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294339:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448330.294345:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448330.294350:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448330.294364:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294370:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448330.294376:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294383:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b800/0xf45a9e4e6b803430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803437 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.294397:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448330.294399:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448330.294400:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448330.294407:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448330.294421:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826274560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448330.294456:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448330.294483:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448330.294489:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826274944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448330.294509:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448330.294540:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826274688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448330.294562:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448330.294590:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448330.294596:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826274816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448330.296389:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448330.296426:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274560 00000100:00100000:2.0:1788448330.296434:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274560 00010000:00010000:2.0:1788448330.296471:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 24 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448330.296490:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274944 00000100:00100000:2.0:1788448330.296493:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274944 00010000:00010000:2.0:1788448330.296505:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 25 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448330.296515:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274688 00000100:00100000:2.0:1788448330.296517:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274688 00010000:00010000:2.0:1788448330.296526:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 26 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448330.296536:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826274816 00000100:00100000:2.0:1788448330.296538:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826274816 00010000:00010000:2.0:1788448330.296547:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 27 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448330.296559:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448330.296567:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+27:3646:x1875323826274560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448330.296578:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448330.296583:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 27 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.296593:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 27 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448330.297376:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.297384:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448330.298065:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274048:0@lo:104: 00000100:00100000:1.0:1788448330.298078:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274176:0@lo:104: 00000100:00100000:1.0:1788448330.298087:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274304:0@lo:104: 00000100:00100000:1.0:1788448330.298094:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826274432:0@lo:104: 00010000:00010000:2.0:1788448330.299123:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b8035bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8035b8 expref: 27 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299142:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448330.299263:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+26:3646:x1875323826274560:12345-0@lo:103:ldlm_bl.0 Request processed in 2696us (4805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.299273:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448330.299313:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448330.299322:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+25:3646:x1875323826274944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448330.299337:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448330.299343:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 25 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299352:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 25 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299362:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1ee00/0xf45a9e4e6b803437 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803430 expref: 25 pid: 6510 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299370:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448330.299394:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826274944:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (4885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.299400:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448330.299412:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448330.299419:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3647:x1875323826274688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448330.299428:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448330.299432:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299448:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299458:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b803499 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803492 expref: 23 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299466:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448330.299504:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3647:x1875323826274688:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (4941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.299510:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448330.299522:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448330.299529:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3647:x1875323826274816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448330.299537:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448330.299541:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299549:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299558:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180031a00/0xf45a9e4e6b803445 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b80343e expref: 21 pid: 6511 timeout: 397 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.299566:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448330.299588:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3647:x1875323826274816:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.299593:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448330.300873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448330.300929:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049472 00000100:00100000:2.0:1788448330.300947:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049472 00010000:00010000:2.0:1788448330.300974:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 10 pid: 6511 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448330.301016:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1788448330.301024:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801049472:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448330.301035:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448330.301041:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 10 pid: 6511 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301052:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 10 pid: 6511 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301069:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301078:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301094:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301102:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301109:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301116:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301122:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448330.301132:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301141:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301151:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448330.301162:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448330.301206:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801049472:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 182us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448330.301214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:1.0:1788448330.302871:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826274816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448330.302917:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826274688:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448330.304478:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1e800/0xf45a9e4e6b8036d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0495 expref: 9 pid: 6511 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448330.304498:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10393:1875323826273920:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448330.304531:0:10393:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448330.304541:0:10393:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448330.304547:0:10393:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448330.304569:0:10393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b80379b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10393 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448330.307718:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826274560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448330.308027:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826274944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448330.755257:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448331.455589:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826275200:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.455652:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.455704:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826275712:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.455741:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.455765:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826276224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.455791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.455815:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788448331.455822:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826275328:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.455844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.455858:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826275840:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.455875:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.455922:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826276352:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.455940:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.455961:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275200 00000100:00100000:1.0:1788448331.455968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275200 00000100:00100000:1.0:1788448331.456003:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275712 00000100:00100000:1.0:1788448331.456006:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275712 00000100:00100000:1.0:1788448331.456026:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276224 00000100:00100000:1.0:1788448331.456041:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276224 00000100:00100000:1.0:1788448331.456056:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275840 00000100:00100000:1.0:1788448331.456059:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275840 00000100:00100000:1.0:1788448331.456070:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276352 00000100:00100000:1.0:1788448331.456073:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276352 00000100:00100000:1.0:1788448331.456088:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448331.456104:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826275200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448331.456140:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788448331.456154:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826275712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.456161:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826275200:12345-0@lo:400:kworker.0 Request processed in 57us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.456170:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448331.456190:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448331.456202:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826275712:12345-0@lo:400:kworker.0 Request processed in 50us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.456203:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826276224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448331.456217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788448331.456238:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448331.456243:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826276224:12345-0@lo:400:kworker.0 Request processed in 45us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448331.456250:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826275840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.456256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448331.456272:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448331.456279:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826276352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.456304:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826276352:12345-0@lo:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.456309:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788448331.456341:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7ca680 x1875323826276352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448331.456355:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826276352:0@lo:400:kworker.0 00000100:00100000:3.0:1788448331.456364:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826275840:12345-0@lo:400:kworker.0 Request processed in 117us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.456368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826275200:0@lo:400:kworker.0 00000100:00100000:3.0:1788448331.456375:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448331.456381:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826275712:0@lo:400:kworker.0 00000100:00100000:1.0:1788448331.456391:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826276224:0@lo:400:kworker.0 00000100:00080000:3.0:1788448331.456399:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448331.456405:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448331.456417:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7ca300 x1875323826275840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448331.456426:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826275840:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456502:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826275072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456533:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.456556:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826275584:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456575:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.456597:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826276096:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456616:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.456635:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826276608:0@lo:400:kworker.0 00000100:00100000:0.0:1788448331.456647:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826275456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456655:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.456687:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.456690:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275328 00000100:00100000:2.0:1788448331.456695:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275328 00000100:00100000:0.0:1788448331.456714:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826275968:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456718:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275584 00000100:00100000:2.0:1788448331.456722:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275584 00000100:00100000:2.0:1788448331.456739:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788448331.456745:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.456750:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826275328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448331.456777:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826276480:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456805:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826275328:12345-0@lo:400:kworker.0 Request processed in 58us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.456813:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.456820:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788448331.456837:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788448331.456846:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826275584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448331.456856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275456 00000100:00100000:0.0:1788448331.456861:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275456 00000100:00100000:2.0:1788448331.456878:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826275584:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.456918:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788448331.456922:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788448331.456931:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826275456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.456940:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276096 00000100:00100000:2.0:1788448331.456944:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276096 00000100:00100000:2.0:1788448331.456973:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276608 00000100:00100000:2.0:1788448331.456977:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276608 00000100:00100000:0.0:1788448331.456985:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826275456:12345-0@lo:400:kworker.0 Request processed in 55us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.456989:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275968 00000100:00100000:2.0:1788448331.456992:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275968 00000100:00100000:0.0:1788448331.457004:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448331.457007:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276480 00000100:00100000:2.0:1788448331.457011:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276480 00000100:00100000:2.0:1788448331.457029:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448331.457037:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448331.457038:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826276096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448331.457051:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826276608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.457077:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826276096:12345-0@lo:400:kworker.0 Request processed in 40us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.457084:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448331.457099:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826276608:12345-0@lo:400:kworker.0 Request processed in 51us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.457101:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448331.457115:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826275968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448331.457115:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448331.457137:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448331.457146:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826276480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.457153:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826275968:12345-0@lo:400:kworker.0 Request processed in 41us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.457160:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788448331.457183:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448331.457183:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826276480:12345-0@lo:400:kworker.0 Request processed in 37us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.457191:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788448331.457194:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448331.457222:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826275584:0@lo:400:kworker.0 00010000:00080000:2.0:1788448331.457240:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cad80 x1875323826276096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448331.457240:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826275456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.457255:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826276096:0@lo:400:kworker.0 00010000:00080000:0.0:1788448331.457263:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7c9880 x1875323826275968/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788448331.457271:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7c8700 x1875323826276608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448331.457276:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826275968:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.457284:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826276608:0@lo:400:kworker.0 00000100:00100000:2.0:1788448331.457311:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826275328:0@lo:400:kworker.0 00010000:00080000:0.0:1788448331.458046:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7c8e00 x1875323826276480/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448331.458058:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826276480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448331.458275:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826275072 00000100:00100000:3.0:1788448331.458290:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826275072 00000100:00100000:3.0:1788448331.458331:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788448331.458340:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3646:x1875323826275072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448331.458391:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3646:x1875323826275072:12345-0@lo:400:kworker.0 Request processed in 52us (1857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448331.458397:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788448331.458656:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826275072:0@lo:400:kworker.0 00000100:00100000:0.0:1788448331.559379:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448331.559462:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049600 00000100:00100000:1.0:1788448331.559473:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049600 00000100:00100000:1.0:1788448331.559538:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 250 00000100:00100000:1.0:1788448331.559549:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:6171:x1875323801049600:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448331.559565:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448331.559584:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e04db expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.559615:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.559626:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.559647:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8200, rc 0) 00000100:00100000:1.0:1788448331.559703:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049600:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 157us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.559711:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 250 00000100:00100000:0.0:1788448331.567682:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448331.568092:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049728 00000100:00100000:1.0:1788448331.568103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049728 00000100:00100000:1.0:1788448331.568172:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:1.0:1788448331.568183:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049728:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.568349:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049728:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 167us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.568358:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:0.0:1788448331.577672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448331.577714:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049856 00000100:00100000:0.0:1788448331.577725:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049856 00000100:00100000:0.0:1788448331.577776:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:0.0:1788448331.577795:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049856:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.577961:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6171:x1875323801049856:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 167us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.577968:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:0.0:1788448331.586621:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448331.586690:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801049984 00000100:00100000:1.0:1788448331.586705:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801049984 00000100:00100000:1.0:1788448331.586776:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:1.0:1788448331.586787:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6715:x1875323801049984:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448331.586965:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6715:x1875323801049984:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 180us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.586974:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:0.0:1788448331.599310:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448331.599538:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050112 00000100:00100000:1.0:1788448331.599553:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050112 00000100:00100000:1.0:1788448331.599629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:1.0:1788448331.599641:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6715:x1875323801050112:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448331.599832:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:6715:x1875323801050112:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 192us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.599841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 254 00010000:00010000:3.0:1788448331.777177:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448331.778086:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448331.778092:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bf749000 from 4 10000000:01000000:2.0:1788448331.778098:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448331.778155:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448331.778169:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448331.778300:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448331.778395:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826276736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448331.778546:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.778609:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc183ece600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.779838:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276736 00000100:00100000:1.0:1788448331.779855:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276736 00000100:00100000:1.0:1788448331.779960:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788448331.779971:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826276736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448331.779992:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448331.780015:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8037a9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.780062:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.780074:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.780084:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8600, rc 0) 00000100:00100000:1.0:1788448331.780191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826276736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 221us (1645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.780198:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788448331.780686:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826276736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448331.780717:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448331.780728:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448331.780824:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826276864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448331.780869:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448331.780948:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0834b4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.781012:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276864 00000100:00100000:1.0:1788448331.781018:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276864 00000100:00100000:1.0:1788448331.781066:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788448331.781075:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826276864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.781235:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826276864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.781242:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788448331.781279:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826276864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.781325:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826276992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.781369:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.781383:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190c9a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.781394:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826276992 00000100:00100000:1.0:1788448331.781397:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826276992 00000100:00100000:1.0:1788448331.781413:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788448331.781418:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826276992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.781515:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826276992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.781523:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788448331.781563:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826276992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.781784:0:10446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10446:1875323826277120:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.781820:0:10446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.781839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277120 00000100:00100000:1.0:1788448331.781851:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277120 00000100:00100000:1.0:1788448331.781870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788448331.781875:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10446:x1875323826277120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.781990:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10446:x1875323826277120:12345-0@lo:502:llog_process_th.0 Request processed in 114us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.781996:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788448331.782024:0:10446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.782035:0:10446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10446:1875323826277120:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448331.782057:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448331.782068:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448331.782070:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788448331.782077:0:10446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1bf749000 00000020:00000080:1.0:1788448331.782080:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788448331.782156:0:10446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10446:1875323826277248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.782189:0:10446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.782209:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277248 00000100:00100000:1.0:1788448331.782213:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277248 00000100:00100000:1.0:1788448331.782228:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788448331.782234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10446:x1875323826277248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.782288:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:10446:x1875323826277248:12345-0@lo:502:llog_process_th.0 Request processed in 53us (98us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.782295:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788448331.782320:0:10446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.782331:0:10446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10446:1875323826277248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448331.782346:0:10446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448331.782350:0:10446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448331.782356:0:10446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788448331.782360:0:10446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788448331.782415:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788448331.782438:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448331.782448:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782460:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448331.782472:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448331.782475:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1ba23b000 from 4 10000000:01000000:1.0:1788448331.782478:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448331.782502:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782511:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782519:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.782532:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826277376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.782560:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.782574:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.782585:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277376 00000100:00100000:1.0:1788448331.782588:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277376 00000100:00100000:1.0:1788448331.782605:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788448331.782611:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826277376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448331.782620:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448331.782639:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8037b7 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782663:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782674:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782683:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9c00, rc 0) 00000100:00100000:1.0:1788448331.782712:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826277376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.782719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788448331.782747:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826277376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448331.782759:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.782768:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.782810:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826277504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.782837:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.782850:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.782860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277504 00000100:00100000:1.0:1788448331.782864:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277504 00000100:00100000:1.0:1788448331.782920:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788448331.782928:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826277504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.783018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826277504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.783031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788448331.783062:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826277504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.783088:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826277632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.783123:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.783136:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.783147:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277632 00000100:00100000:1.0:1788448331.783151:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277632 00000100:00100000:1.0:1788448331.783170:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788448331.783176:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826277632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.783247:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826277632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.783254:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788448331.783290:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826277632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.795749:0:10447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10447:1875323826277760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.795869:0:10447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.795966:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277760 00000100:00100000:1.0:1788448331.795975:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277760 00000100:00100000:1.0:1788448331.796049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788448331.796061:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10447:x1875323826277760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.796387:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10447:x1875323826277760:12345-0@lo:502:llog_process_th.0 Request processed in 326us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.796396:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788448331.796933:0:10447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.796974:0:10447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10447:1875323826277760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448331.797024:0:10447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448331.798151:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448331.798159:0:10447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788448331.798171:0:10447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1ba23b000 00000020:00000080:1.0:1788448331.798422:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788448331.799952:0:10447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10447:1875323826277888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448331.800399:0:10447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.801134:0:10447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448331.802173:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826277888 00000100:00100000:2.0:1788448331.802432:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826277888 00000100:00100000:2.0:1788448331.802567:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788448331.802580:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10447:x1875323826277888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448331.802792:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:10447:x1875323826277888:12345-0@lo:502:llog_process_th.0 Request processed in 214us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.802801:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788448331.804686:0:10447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10447:1875323826277888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448331.804747:0:10447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448331.804759:0:10447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448331.804762:0:10447:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788448331.804766:0:10447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788448331.807921:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788448331.807971:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448331.807986:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.808000:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448331.808013:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788448331.808017:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc19ea22000 from 4 10000000:01000000:0.0:1788448331.808020:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448331.808068:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.808077:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.808089:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448331.808120:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.808217:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.808272:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1863d30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448331.809315:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278016 00000100:00100000:1.0:1788448331.809328:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278016 00000100:00100000:1.0:1788448331.809397:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788448331.809408:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826278016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448331.809426:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448331.809445:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8037c5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.809656:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.809670:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.809680:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8000, rc 0) 00000100:00100000:1.0:1788448331.809761:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826278016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 353us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.809777:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788448331.809847:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448331.809869:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.809909:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.810007:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.810047:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.810080:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.811043:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278144 00000100:00100000:0.0:1788448331.811055:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278144 00000100:00100000:0.0:1788448331.811131:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788448331.811141:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826278144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.812593:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826278144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1444us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.812606:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788448331.814088:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.814191:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448331.814278:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.814404:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.814602:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278272 00000100:00100000:0.0:1788448331.814610:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278272 00000100:00100000:0.0:1788448331.814680:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788448331.814693:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826278272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.814854:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826278272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.814863:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788448331.815062:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.816551:0:10451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10451:1875323826278400:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448331.816647:0:10451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.816705:0:10451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448331.816996:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278400 00000100:00100000:3.0:1788448331.817006:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278400 00000100:00100000:3.0:1788448331.817068:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788448331.817083:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10451:x1875323826278400:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448331.817258:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10451:x1875323826278400:12345-0@lo:502:llog_process_th.0 Request processed in 179us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448331.817268:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788448331.817385:0:10451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10451:1875323826278400:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448331.817422:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448331.817433:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448331.817436:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788448331.817444:0:10451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc19ea22000 00000020:00000080:0.0:1788448331.817514:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448331.817613:0:10451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10451:1875323826278528:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448331.817655:0:10451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.817689:0:10451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.817956:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278528 00000100:00100000:0.0:1788448331.817970:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278528 00000100:00100000:0.0:1788448331.818004:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788448331.818011:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10451:x1875323826278528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448331.818107:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:10451:x1875323826278528:12345-0@lo:502:llog_process_th.0 Request processed in 95us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.818113:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788448331.818153:0:10451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10451:1875323826278528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448331.818171:0:10451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448331.819931:0:10451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448331.819940:0:10451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788448331.819948:0:10451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788448331.823753:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788448331.823809:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448331.823825:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448331.823840:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448331.823853:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448331.823857:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc190ac6000 from 4 10000000:01000000:3.0:1788448331.823860:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448331.823937:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448331.823954:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448331.823970:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448331.824004:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448331.824102:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448331.824168:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.824281:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278656 00000100:00100000:0.0:1788448331.824292:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278656 00000100:00100000:0.0:1788448331.824429:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788448331.824443:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826278656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448331.824644:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448331.824664:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8037d3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.824696:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.824709:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.824719:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f600, rc 0) 00000100:00100000:0.0:1788448331.824780:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826278656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 340us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.824799:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788448331.824865:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448331.824928:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.824942:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448331.825016:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.825047:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.825083:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448331.825098:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278784 00000100:00100000:3.0:1788448331.825103:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278784 00000100:00100000:3.0:1788448331.825140:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788448331.825148:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826278784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448331.825284:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826278784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448331.825291:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788448331.827064:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.827140:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.827225:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.827266:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.827289:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826278912 00000100:00100000:0.0:1788448331.827295:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826278912 00000100:00100000:0.0:1788448331.827349:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788448331.827363:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826278912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.827494:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826278912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.827502:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788448331.827554:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826278912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448331.828391:0:10453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10453:1875323826279040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448331.828535:0:10453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.828572:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279040 00000100:00100000:0.0:1788448331.828579:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279040 00000100:00100000:0.0:1788448331.828623:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788448331.828633:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:10453:x1875323826279040:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448331.828755:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:10453:x1875323826279040:12345-0@lo:502:llog_process_th.0 Request processed in 123us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.828763:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788448331.828814:0:10453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.828834:0:10453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10453:1875323826279040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448331.828863:0:10453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448331.828875:0:10453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448331.828878:0:10453:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788448331.828923:0:10453:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc190ac6000 00000020:00000080:0.0:1788448331.828926:0:10453:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448331.829016:0:10453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10453:1875323826279168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448331.829054:0:10453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.829071:0:10453:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448331.829215:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279168 00000100:00100000:3.0:1788448331.829221:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279168 00000100:00100000:3.0:1788448331.829264:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788448331.829273:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:10453:x1875323826279168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448331.829365:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:10453:x1875323826279168:12345-0@lo:502:llog_process_th.0 Request processed in 93us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448331.829372:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788448331.829392:0:10453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:10453:1875323826279168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448331.829415:0:10453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448331.829421:0:10453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448331.829423:0:10453:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788448331.829427:0:10453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788448331.830528:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788448331.830559:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448331.830571:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.830598:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.968254:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826279296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448331.968355:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.968458:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279296 00000100:00100000:1.0:1788448331.968468:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279296 00000100:00100000:1.0:1788448331.968523:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448331.968534:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826279296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448331.968571:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448331.968624:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826279296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448331.968632:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1788448331.968692:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08368aa00 x1875323826279296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448331.968715:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826279296:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448331.968871:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448331.968913:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826279424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448331.968947:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.969113:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279424 00000100:00100000:0.0:1788448331.969118:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279424 00000100:00100000:0.0:1788448331.969149:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448331.969155:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826279424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448331.969168:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448331.969200:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826279424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.969208:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788448331.969248:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb575c00 x1875323826279424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448331.969265:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb575c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826279424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448332.478948:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826279552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448332.479051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448332.479204:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279552 00000100:00100000:2.0:1788448332.479216:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279552 00000100:00100000:2.0:1788448332.479285:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788448332.479296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826279552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448332.479356:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788448332.479424:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826279552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 130us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448332.479433:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788448332.479493:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826279552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448332.659799:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448332.659856:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448332.659931:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050368 00000100:00100000:3.0:1788448332.659934:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050240 00000100:00100000:3.0:1788448332.659944:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050240 00000100:00100000:1.0:1788448332.659944:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050368 00000100:00100000:1.0:1788448332.660017:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:3.0:1788448332.660018:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 275 00000100:00100000:1.0:1788448332.660031:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801050368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448332.660049:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801050240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448332.660128:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801050368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 100us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.660136:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00080000:1.0:1788448332.660161:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448332.660588:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801050240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 541us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448332.660597:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 275 00000100:00100000:1.0:1788448332.660621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448332.660920:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050624 00000100:00100000:0.0:1788448332.660927:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050624 00000100:00100000:0.0:1788448332.660970:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:0.0:1788448332.660979:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801050624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448332.661015:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801050624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448332.661032:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00080000:0.0:1788448332.661059:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448332.668529:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448332.668580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448332.668627:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050752 00000100:00100000:0.0:1788448332.668639:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050752 00000100:00100000:0.0:1788448332.668712:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:0.0:1788448332.668725:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801050752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448332.668932:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050496 00000100:00100000:3.0:1788448332.668938:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050496 00000100:00100000:3.0:1788448332.668983:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1788448332.668994:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801050496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448332.669073:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801050496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 81us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448332.669081:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:0.0:1788448332.670806:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801050752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2072us (2211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448332.670823:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00080000:0.0:1788448332.670904:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448332.670911:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788448332.799227:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448333.822069:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448334.526160:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826279680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448334.526267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448334.526690:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279680 00000100:00100000:2.0:1788448334.526702:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279680 00000100:00100000:2.0:1788448334.526777:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448334.526789:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826279680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448334.526828:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448334.527007:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826279808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448334.527048:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448334.528654:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826279936:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448334.528724:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448334.533420:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826279680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6619us (7137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448334.533439:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448334.533483:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279936 00000100:00100000:2.0:1788448334.533495:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279936 00000100:00100000:2.0:1788448334.533561:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448334.533571:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826279936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448334.533603:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448334.533770:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826279936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 200us (5046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448334.533777:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788448334.533808:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448334.533829:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826279808 00000100:00100000:2.0:1788448334.533833:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826279808 00000100:00100000:2.0:1788448334.533909:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448334.533917:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826279808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448334.533949:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448334.533990:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826279808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (6942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448334.534008:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448334.534070:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826279808:0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788448334.536029:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb574e00 x1875323826279680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448334.536061:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826279680:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788448334.537195:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cd180 x1875323826279936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448334.537218:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826279936:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788448334.846483:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448335.870171:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448336.576827:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826280064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.576926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.576980:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826280576:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577006:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577022:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826281088:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577055:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826281600:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577072:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577090:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788448336.577096:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826280192:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577130:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826280704:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577145:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577159:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826281216:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577176:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577208:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826280320:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577228:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577243:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826280832:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577291:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826281344:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577325:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788448336.577330:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826280448:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577359:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826280960:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577378:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577403:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826281472:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448336.577483:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280064 00000100:00100000:0.0:1788448336.577491:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280064 00000100:00100000:0.0:1788448336.577534:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788448336.577542:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577587:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826280064:12345-0@lo:400:kworker.0 Request processed in 45us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.577594:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788448336.577625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280576 00000100:00100000:0.0:1788448336.577629:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280576 00000100:00100000:0.0:1788448336.577645:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280320 00000100:00100000:0.0:1788448336.577647:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280320 00000100:00100000:0.0:1788448336.577659:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788448336.577665:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826280576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.577694:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826280576:12345-0@lo:400:kworker.0 Request processed in 29us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.577701:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788448336.577712:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788448336.577718:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826280320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.580577:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826280320:12345-0@lo:400:kworker.0 Request processed in 2850us (3338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.580591:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788448336.580634:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281088 00000100:00100000:0.0:1788448336.580642:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281088 00000100:00100000:0.0:1788448336.580683:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281600 00000100:00100000:0.0:1788448336.580686:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281600 00000100:00100000:0.0:1788448336.580696:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280960 00000100:00100000:0.0:1788448336.580704:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280960 00000100:00100000:0.0:1788448336.580719:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281472 00000100:00100000:0.0:1788448336.580721:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281472 00000100:00100000:0.0:1788448336.580817:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448336.580825:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826281088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581014:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826281088:12345-0@lo:400:kworker.0 Request processed in 190us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581021:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448336.581035:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448336.581042:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826281600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581074:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826281600:12345-0@lo:400:kworker.0 Request processed in 33us (4001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581079:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448336.581089:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448336.581095:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826280960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581120:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826280960:12345-0@lo:400:kworker.0 Request processed in 26us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581125:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448336.581135:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448336.581141:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826281472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581166:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826281472:12345-0@lo:400:kworker.0 Request processed in 25us (3741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581171:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448336.581194:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280192 00000100:00100000:0.0:1788448336.581198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280192 00000100:00100000:0.0:1788448336.581217:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280704 00000100:00100000:0.0:1788448336.581219:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280704 00000100:00100000:0.0:1788448336.581242:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281216 00000100:00100000:0.0:1788448336.581245:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281216 00000100:00100000:0.0:1788448336.581257:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280832 00000100:00100000:0.0:1788448336.581259:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280832 00000100:00100000:0.0:1788448336.581271:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281344 00000100:00100000:0.0:1788448336.581273:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281344 00000100:00100000:0.0:1788448336.581284:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826280448 00000100:00100000:0.0:1788448336.581287:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826280448 00000100:00100000:0.0:1788448336.581299:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788448336.581304:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826280192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581346:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826280192:12345-0@lo:400:kworker.0 Request processed in 41us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581352:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788448336.581364:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448336.581370:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826280704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581396:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826280704:12345-0@lo:400:kworker.0 Request processed in 27us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581402:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448336.581414:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788448336.581420:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826281216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581452:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826281216:12345-0@lo:400:kworker.0 Request processed in 32us (4275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581458:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788448336.581468:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448336.581474:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826280832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581499:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826280832:12345-0@lo:400:kworker.0 Request processed in 26us (4227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581514:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448336.581526:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788448336.581532:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826281344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581561:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826281344:12345-0@lo:400:kworker.0 Request processed in 30us (4249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581567:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788448336.581577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448336.581583:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826280448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581610:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826280448:12345-0@lo:400:kworker.0 Request processed in 26us (4259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448336.581615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448336.581682:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826280448:0@lo:400:kworker.0 00010000:00080000:0.0:1788448336.581698:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f8a80 x1875323826280960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448336.581709:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826280960:0@lo:400:kworker.0 00010000:00080000:0.0:1788448336.581720:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fb100 x1875323826281472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448336.581728:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826281472:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.581740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826280320:0@lo:400:kworker.0 00010000:00080000:0.0:1788448336.581766:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f8e00 x1875323826280832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448336.581774:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826280832:0@lo:400:kworker.0 00010000:00080000:0.0:1788448336.581794:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fa680 x1875323826281344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448336.581803:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826281344:0@lo:400:kworker.0 00000100:00080000:1.0:1788448336.583183:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448336.583190:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448336.583192:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448336.583195:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448336.584166:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826280192:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.584183:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826280704:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.584194:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826281216:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.584204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826280064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448336.584215:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826280576:0@lo:400:kworker.0 00010000:00080000:0.0:1788448336.584228:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fb480 x1875323826281088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448336.584238:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826281088:0@lo:400:kworker.0 00010000:00080000:0.0:1788448336.584249:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f9880 x1875323826281600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448336.584258:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826281600:0@lo:400:kworker.0 00010000:00010000:0.0:1788448336.894145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448337.094502:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826281856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448337.094571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448337.094855:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448337.094895:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826281728:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448337.094941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448337.094988:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281856 00000100:00100000:1.0:1788448337.094997:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281856 00000100:00100000:1.0:1788448337.095031:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281728 00000100:00100000:1.0:1788448337.095034:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281728 00000100:00100000:1.0:1788448337.095050:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448337.095058:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826281856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448337.095084:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448337.095125:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826281856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448337.095132:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448337.095318:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448337.095329:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826281728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448337.095341:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448337.095373:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826281728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448337.095379:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788448337.095411:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836edf80 x1875323826281856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448337.095427:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826281856:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788448337.095455:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083688700 x1875323826281728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448337.095466:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826281728:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1788448337.118231:0:10692:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1788448337.599361:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826281984:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448337.599441:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448337.600028:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826281984 00000100:00100000:0.0:1788448337.600104:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826281984 00000100:00100000:0.0:1788448337.600231:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788448337.600242:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826281984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448337.600292:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448337.600370:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826281984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448337.600378:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448337.600612:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826281984:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448337.786789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448337.786838:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448337.786904:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448337.786926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448337.786949:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448337.786979:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051136 00000100:00100000:0.0:1788448337.786988:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051136 00000100:00100000:0.0:1788448337.787046:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051008 00000100:00100000:0.0:1788448337.787049:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051008 00000100:00100000:0.0:1788448337.787075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:0.0:1788448337.787086:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801051136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448337.787154:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801051136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448337.787161:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:0.0:1788448337.787178:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:0.0:1788448337.787185:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801051008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448337.787210:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801051008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448337.787216:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:0.0:1788448337.787234:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051392 00000100:00100000:0.0:1788448337.787237:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051392 00000100:00100000:0.0:1788448337.787262:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051264 00000100:00100000:0.0:1788448337.787273:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051264 00000100:00100000:0.0:1788448337.787297:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1788448337.787303:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801051392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448337.787330:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801051392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448337.787336:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1788448337.787348:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1788448337.787354:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801051264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448337.787375:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801051264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448337.787381:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:1.0:1788448337.787677:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801050880 00000100:00100000:1.0:1788448337.787682:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801050880 00000100:00100000:1.0:1788448337.787724:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00100000:1.0:1788448337.787732:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2401:x1875323801050880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448337.787766:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2401:x1875323801050880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448337.787772:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00080000:1.0:1788448337.787795:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448337.787799:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448337.787801:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448337.787803:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788448337.918108:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448338.945333:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448339.646118:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448339.646141:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826282112:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448339.646214:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448339.646552:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448339.646564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826282240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448339.646599:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448339.646680:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282240 00000100:00100000:3.0:1788448339.646687:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282240 00000100:00100000:3.0:1788448339.646749:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448339.646760:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826282240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448339.646789:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448339.646830:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826282240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448339.646837:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788448339.646918:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448339.646945:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cf100 x1875323826282240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448339.646972:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826282240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448339.647082:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282112 00000100:00100000:2.0:1788448339.647087:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282112 00000100:00100000:2.0:1788448339.647118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788448339.647125:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826282112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448339.647147:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448339.647206:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826282112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448339.647213:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448339.647389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826282112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448339.653706:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448339.658162:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826282368:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448339.658235:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448339.663491:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282368 00000100:00100000:1.0:1788448339.663505:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282368 00000100:00100000:1.0:1788448339.663579:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788448339.663590:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826282368:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448339.663614:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448339.663694:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826282368:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (5459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448339.663701:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788448339.663750:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cd880 x1875323826282368/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448339.663778:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826282368:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788448339.663917:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448339.966101:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448340.996029:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448341.697986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826282624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448341.698107:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826283136:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698131:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448341.698155:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826283648:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448341.698213:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788448341.698219:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826282752:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698244:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448341.698262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826283264:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448341.698295:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826283776:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698312:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448341.698338:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282624 00000100:00100000:2.0:1788448341.698345:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282624 00000100:00100000:2.0:1788448341.698378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283136 00000100:00100000:2.0:1788448341.698381:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283136 00000100:00100000:2.0:1788448341.698402:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283648 00000100:00100000:2.0:1788448341.698405:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283648 00000100:00100000:2.0:1788448341.698419:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283264 00000100:00100000:2.0:1788448341.698422:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283264 00000100:00100000:2.0:1788448341.698433:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283776 00000100:00100000:2.0:1788448341.698435:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283776 00000100:00100000:2.0:1788448341.698461:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448341.698470:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826282624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698530:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826282624:12345-0@lo:400:kworker.0 Request processed in 61us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.698537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448341.698553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788448341.698559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826283136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698586:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826283136:12345-0@lo:400:kworker.0 Request processed in 28us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.698591:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788448341.698602:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788448341.698608:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826283648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698633:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826283648:12345-0@lo:400:kworker.0 Request processed in 26us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.698638:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788448341.698650:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788448341.698656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826283264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698696:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826283264:12345-0@lo:400:kworker.0 Request processed in 41us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.698702:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788448341.698713:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448341.698719:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826283776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698743:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826283776:12345-0@lo:400:kworker.0 Request processed in 25us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.698748:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448341.698776:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282752 00000100:00100000:2.0:1788448341.698780:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282752 00000100:00100000:2.0:1788448341.698802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788448341.698808:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826282752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698850:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826282752:12345-0@lo:400:kworker.0 Request processed in 42us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.698856:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788448341.698872:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448341.698876:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448341.698926:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826282752:0@lo:400:kworker.0 00010000:00080000:2.0:1788448341.698940:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9f80 x1875323826283264/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448341.698950:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826283264:0@lo:400:kworker.0 00010000:00080000:2.0:1788448341.698959:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e6680 x1875323826283776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448341.698967:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826283776:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698976:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826282624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698985:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826283136:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.698993:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826283648:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699212:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826282880:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699244:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699278:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826283392:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699309:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699336:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826283904:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699357:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699378:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788448341.699385:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826282496:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699431:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826283008:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699470:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826283520:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699490:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699506:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826284032:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699525:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448341.699550:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283008 00000100:00100000:3.0:1788448341.699555:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283008 00000100:00100000:3.0:1788448341.699576:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448341.699582:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826283008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699620:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826283008:12345-0@lo:400:kworker.0 Request processed in 37us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448341.699625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448341.699644:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283392 00000100:00100000:3.0:1788448341.699648:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283392 00000100:00100000:3.0:1788448341.699686:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283904 00000100:00100000:3.0:1788448341.699690:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283904 00000100:00100000:3.0:1788448341.699702:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826283520 00000100:00100000:3.0:1788448341.699704:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826283520 00000100:00100000:3.0:1788448341.699715:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284032 00000100:00100000:3.0:1788448341.699724:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284032 00000100:00100000:3.0:1788448341.699741:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788448341.699747:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826283392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.699780:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5e8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826283392:12345-0@lo:400:kworker.0 Request processed in 33us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448341.699787:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788448341.699971:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448341.699978:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826283904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.700007:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826283904:12345-0@lo:400:kworker.0 Request processed in 29us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448341.700013:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448341.700025:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448341.700031:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826283520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.700058:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826283520:12345-0@lo:400:kworker.0 Request processed in 27us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448341.700063:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448341.700073:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448341.700079:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826284032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.700105:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826284032:12345-0@lo:400:kworker.0 Request processed in 26us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448341.700111:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448341.700133:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282496 00000100:00100000:3.0:1788448341.700136:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282496 00000100:00100000:3.0:1788448341.700164:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788448341.700171:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826282496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.700199:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826282496:12345-0@lo:400:kworker.0 Request processed in 29us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448341.700212:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1788448341.700245:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448341.700248:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448341.700270:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826282496:0@lo:400:kworker.0 00000100:00100000:3.0:1788448341.700281:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826283008:0@lo:400:kworker.0 00010000:00080000:3.0:1788448341.700292:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b4700 x1875323826283520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448341.700302:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826283520:0@lo:400:kworker.0 00010000:00080000:3.0:1788448341.700312:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5880 x1875323826284032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448341.700321:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826284032:0@lo:400:kworker.0 00010000:00080000:3.0:1788448341.700330:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f8700 x1875323826283392/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448341.700338:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826283392:0@lo:400:kworker.0 00010000:00080000:3.0:1788448341.700347:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e7100 x1875323826283904/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448341.700354:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826283904:0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.700948:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826282880 00000100:00100000:2.0:1788448341.700954:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826282880 00000100:00100000:2.0:1788448341.700988:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448341.700995:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826282880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448341.701037:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826282880:12345-0@lo:400:kworker.0 Request processed in 42us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448341.701049:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788448341.701990:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826282880:0@lo:400:kworker.0 00000001:02000400:3.0:1788448341.904141:0:10937:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing yml_node 00010000:00010000:3.0:1788448342.020642:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448342.206351:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826284160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448342.206426:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448342.206497:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448342.206503:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826284288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448342.206525:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448342.207367:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284160 00000100:00100000:1.0:1788448342.207376:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284160 00000100:00100000:1.0:1788448342.207413:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284288 00000100:00100000:1.0:1788448342.207416:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284288 00000100:00100000:1.0:1788448342.207429:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448342.207440:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826284160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448342.207468:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448342.207525:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826284160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448342.207532:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448342.207548:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448342.207554:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826284288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448342.207564:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448342.207585:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826284288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448342.207591:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788448342.207906:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ed880 x1875323826284288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448342.207925:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826284288:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788448342.207937:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083688a80 x1875323826284160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448342.207947:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826284160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448342.719299:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448342.719331:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826284416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448342.719428:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448342.719674:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284416 00000100:00100000:1.0:1788448342.719685:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284416 00000100:00100000:1.0:1788448342.719744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788448342.719755:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826284416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448342.719798:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448342.719865:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826284416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448342.719873:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448342.720177:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826284416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448342.895765:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448342.895816:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448342.895863:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448342.895927:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051776 00000100:00100000:0.0:1788448342.895940:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051776 00000100:00100000:0.0:1788448342.896033:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051648 00000100:00100000:0.0:1788448342.896037:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051648 00000100:00100000:0.0:1788448342.896065:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:0.0:1788448342.896078:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801051776:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448342.896187:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801051776:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 111us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448342.896195:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:0.0:1788448342.896446:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:0.0:1788448342.896454:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801051648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448342.896487:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801051648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448342.896494:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00080000:0.0:1788448342.896530:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448342.896535:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448342.905825:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051520 00000100:00100000:3.0:1788448342.905858:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051520 00000100:00100000:3.0:1788448342.906082:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 279 00000100:00100000:3.0:1788448342.906094:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801051520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448342.906199:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801051520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 107us (10451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448342.906208:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 279 00000100:00100000:0.0:1788448342.906397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448342.906552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448342.906623:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801051904 00000100:00100000:3.0:1788448342.906628:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801051904 00000100:00100000:3.0:1788448342.906676:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052032 00000100:00100000:3.0:1788448342.906678:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052032 00000100:00100000:3.0:1788448342.906702:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:3.0:1788448342.906777:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2397:x1875323801051904:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788448342.906814:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8036ec 00000100:00080000:3.0:1788448342.906826:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fc082763800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448342.906916:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788448342.907082:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+2:2397:x1875323801051904:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 372us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448342.907089:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:3.0:1788448342.907104:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448342.907111:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2397:x1875323801052032:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788448342.907125:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8036f3 00000100:00080000:3.0:1788448342.907131:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fc1b5c9f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448342.907156:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788448342.907227:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+2:2397:x1875323801052032:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 115us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448342.907234:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00010000:00010000:3.0:1788448342.907327:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448342.907346:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448342.907492:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448342.907497:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448343.038194:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448344.064379:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448344.766529:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826284544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448344.766625:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448344.766743:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284544 00000100:00100000:1.0:1788448344.766753:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284544 00000100:00100000:1.0:1788448344.766818:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448344.766842:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826284544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448344.766910:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448344.767040:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826284672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448344.767078:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448344.767145:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284672 00000100:00100000:2.0:1788448344.767150:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284672 00000100:00100000:2.0:1788448344.767182:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448344.767188:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826284672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448344.767217:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448344.767272:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826284672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448344.767279:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448344.767404:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826284800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448344.767430:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448344.767466:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788448344.767475:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1788448344.767511:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826284672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448344.767584:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284800 00000100:00100000:2.0:1788448344.767588:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284800 00000100:00100000:2.0:1788448344.767683:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448344.767690:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826284800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448344.767702:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448344.767732:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826284800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448344.767739:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788448344.767765:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cdc00 x1875323826284800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448344.767779:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826284800:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788448344.767960:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448344.768597:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826284544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1755us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448344.768606:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788448344.777125:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08368ad80 x1875323826284544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448344.777165:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826284544:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788448345.088245:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448346.117853:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448346.776159:0:11122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00000100:00100000:0.0:1788448346.821715:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826284928:0@lo:400:kworker.0 00000100:00100000:0.0:1788448346.821785:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448346.821957:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826284928 00000100:00100000:1.0:1788448346.821965:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826284928 00000100:00100000:1.0:1788448346.822009:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788448346.822017:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826284928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.831253:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826285056:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.831350:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448346.831416:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285056 00000100:00100000:3.0:1788448346.831424:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285056 00000100:00100000:3.0:1788448346.831473:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788448346.831481:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826285056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.831662:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826285056:12345-0@lo:400:kworker.0 Request processed in 181us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448346.831670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788448346.831786:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826285056:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.831866:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826284928:12345-0@lo:400:kworker.0 Request processed in 5253us (5485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448346.831877:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788448346.833744:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448346.833763:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826285440:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.833831:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448346.833910:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826285568:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.833935:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448346.833965:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285568 00000100:00100000:3.0:1788448346.833971:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285568 00000100:00100000:3.0:1788448346.834019:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788448346.834027:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826285568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834071:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826285568:12345-0@lo:400:kworker.0 Request processed in 45us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448346.834094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788448346.834114:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448346.834143:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826285568:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834184:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448346.834190:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826285952:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834217:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448346.834241:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285952 00000100:00100000:3.0:1788448346.834244:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285952 00000100:00100000:3.0:1788448346.834272:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448346.834294:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826285952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834330:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826285952:12345-0@lo:400:kworker.0 Request processed in 52us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448346.834337:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788448346.834352:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448346.834372:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cdc00 x1875323826285952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448346.834384:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826285952:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834414:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826286080:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448346.834461:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286080 00000100:00100000:3.0:1788448346.834465:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286080 00000100:00100000:3.0:1788448346.834491:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788448346.834497:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826286080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834547:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826286080:12345-0@lo:400:kworker.0 Request processed in 50us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448346.834564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788448346.834578:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448346.834598:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826286080:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834636:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448346.834643:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826286464:0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834669:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448346.834692:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286464 00000100:00100000:3.0:1788448346.834696:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286464 00000100:00100000:3.0:1788448346.834722:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448346.834728:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826286464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448346.834761:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826286464:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448346.834767:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788448346.834780:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788448346.834799:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cdc00 x1875323826286464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448346.834808:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826286464:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835191:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826285312:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835223:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448346.835246:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826285824:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448346.835297:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826286336:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835319:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448346.835335:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788448346.835343:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826285184:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835365:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448346.835380:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826285696:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835413:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448346.835427:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826286208:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.835443:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448346.835645:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285440 00000100:00100000:2.0:1788448346.835650:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285440 00000100:00100000:2.0:1788448346.835674:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285184 00000100:00100000:2.0:1788448346.835677:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285184 00000100:00100000:2.0:1788448346.835702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788448346.835710:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826285440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.835763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826285440:12345-0@lo:400:kworker.0 Request processed in 54us (1933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.835777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788448346.835793:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788448346.835798:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826285184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.835845:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826285184:12345-0@lo:400:kworker.0 Request processed in 47us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.835851:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788448346.835900:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826285184:0@lo:400:kworker.0 00000100:00100000:1.0:1788448346.836019:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826285440:0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.837456:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285824 00000100:00100000:2.0:1788448346.837465:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285824 00000100:00100000:2.0:1788448346.837593:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286336 00000100:00100000:2.0:1788448346.837598:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286336 00000100:00100000:2.0:1788448346.837623:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448346.837631:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826285824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.837766:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826285824:12345-0@lo:400:kworker.0 Request processed in 135us (2497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.837774:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448346.837790:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448346.837796:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826286336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.837839:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826286336:12345-0@lo:400:kworker.0 Request processed in 43us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.837845:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448346.837868:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285312 00000100:00100000:2.0:1788448346.837873:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285312 00000100:00100000:2.0:1788448346.837918:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826285696 00000100:00100000:2.0:1788448346.837922:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826285696 00000100:00100000:2.0:1788448346.837937:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286208 00000100:00100000:2.0:1788448346.837952:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286208 00000100:00100000:2.0:1788448346.837972:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448346.837978:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826285312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.838011:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826285312:12345-0@lo:400:kworker.0 Request processed in 33us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.838016:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448346.838028:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788448346.838034:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826285696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.838062:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826285696:12345-0@lo:400:kworker.0 Request processed in 29us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.838068:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788448346.838077:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788448346.838082:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826286208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.838106:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826286208:12345-0@lo:400:kworker.0 Request processed in 23us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448346.838111:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:2.0:1788448346.838154:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083418700 x1875323826285696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448346.838168:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826285696:0@lo:400:kworker.0 00010000:00080000:2.0:1788448346.838180:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb425180 x1875323826286208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448346.838188:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826286208:0@lo:400:kworker.0 00000100:00100000:2.0:1788448346.838199:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826285312:0@lo:400:kworker.0 00010000:00080000:2.0:1788448346.838209:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083418e00 x1875323826285824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448346.838226:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826285824:0@lo:400:kworker.0 00010000:00080000:2.0:1788448346.838239:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424e00 x1875323826286336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448346.838247:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826286336:0@lo:400:kworker.0 00000100:00080000:1.0:1788448346.838430:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448346.838435:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448346.838437:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448346.839845:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826284928:0@lo:400:kworker.0 00010000:00010000:3.0:1788448347.134100:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448347.328155:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826286592:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448347.328212:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448347.328239:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826286720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448347.328254:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448347.328327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448347.328363:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286592 00000100:00100000:2.0:1788448347.328373:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286592 00000100:00100000:2.0:1788448347.328429:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286720 00000100:00100000:2.0:1788448347.328433:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286720 00000100:00100000:2.0:1788448347.328451:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448347.328460:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826286592:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448347.328494:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448347.328546:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826286592:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448347.328553:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448347.328570:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448347.328577:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826286720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448347.328587:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448347.328620:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826286720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448347.328626:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788448347.328659:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341ce00 x1875323826286592/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448347.328691:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826286592:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788448347.329478:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836edc00 x1875323826286720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448347.331575:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826286720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448347.839457:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448347.839484:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826286848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448347.839566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448347.840216:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286848 00000100:00100000:0.0:1788448347.840225:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286848 00000100:00100000:0.0:1788448347.840269:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448347.840279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826286848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448347.840309:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448347.840367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826286848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448347.840375:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448347.840415:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826286848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448348.019917:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448348.019956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448348.019991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448348.020021:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052416 00000100:00100000:2.0:1788448348.020033:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052416 00000100:00100000:2.0:1788448348.020089:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052288 00000100:00100000:2.0:1788448348.020093:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052288 00000100:00100000:2.0:1788448348.020117:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:2.0:1788448348.020128:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801052416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448348.020195:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801052416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448348.020203:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:2.0:1788448348.020221:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:2.0:1788448348.020228:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801052288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448348.020261:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801052288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448348.020412:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00080000:1.0:1788448348.020904:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448348.020910:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448348.028052:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052160 00000100:00100000:3.0:1788448348.028072:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052160 00000100:00100000:2.0:1788448348.028205:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 281 00000100:00100000:2.0:1788448348.028216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801052160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448348.028306:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801052160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (8427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448348.028321:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 281 00010000:00010000:2.0:1788448348.158384:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448348.365483:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:1.0:1788448348.365492:0:9511:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9d000/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:3.0:1788448348.365559:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9d000/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-OST0001 00000020:00000080:3.0:1788448348.365610:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b5c9f000 for lustre-OST0001 00000001:00100000:2.0:1788448348.365877:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:2.0:1788448348.365897:0:8427:0:(genops.c:885:class_export_put()) final put ffff9fc082763000/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:0.0:1788448348.368400:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082763000/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-OST0000 00000020:00000080:0.0:1788448348.372954:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc082763800 for lustre-OST0000 00010000:00010000:3.0:1788448349.186914:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788448349.798225:0:11219:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:3.0:1788448349.887056:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448349.887087:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826286976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448349.887182:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448349.887490:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826286976 00000100:00100000:1.0:1788448349.887501:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826286976 00000100:00100000:1.0:1788448349.887576:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448349.887588:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826286976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448349.887623:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448349.887680:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826286976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448349.887688:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1788448349.887746:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083688000 x1875323826286976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448349.887770:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826286976:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448349.887908:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448349.888024:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448349.888036:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826287232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448349.888074:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448349.888088:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826287104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448349.888124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448349.888157:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448349.888323:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287232 00000100:00100000:2.0:1788448349.888329:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287232 00000100:00100000:2.0:1788448349.888362:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788448349.888370:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826287232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448349.888402:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448349.888411:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287104 00000100:00100000:3.0:1788448349.888416:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287104 00000100:00100000:3.0:1788448349.888453:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448349.888474:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826287104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448349.888487:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448349.888525:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826287104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448349.888533:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788448349.888553:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448349.888561:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826287232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448349.888569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788448349.888609:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826287232:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788448349.889429:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e4e00 x1875323826287104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448349.889449:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826287104:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788448350.206879:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448351.230932:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448351.934752:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826287616:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.934841:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.934927:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826288128:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.934952:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.934972:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826288640:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.934992:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935016:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788448351.935022:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826287488:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935044:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935059:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826288000:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935093:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935109:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826288512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935129:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935160:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826287744:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935181:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935193:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826288256:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935237:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826288768:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935290:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788448351.935296:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935342:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826287872:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935380:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826288384:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935417:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826288896:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935437:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448351.935481:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288256 00000100:00100000:0.0:1788448351.935489:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288256 00000100:00100000:0.0:1788448351.935533:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288768 00000100:00100000:0.0:1788448351.935537:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288768 00000100:00100000:0.0:1788448351.935548:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288384 00000100:00100000:0.0:1788448351.935550:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288384 00000100:00100000:0.0:1788448351.935560:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288896 00000100:00100000:0.0:1788448351.935562:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288896 00000100:00100000:0.0:1788448351.935584:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448351.935592:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826288256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935640:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826288256:12345-0@lo:400:kworker.0 Request processed in 48us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.935647:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448351.935665:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448351.935671:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826288768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935700:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826288768:12345-0@lo:400:kworker.0 Request processed in 30us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.935706:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448351.935717:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788448351.935723:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826288384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935748:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826288384:12345-0@lo:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.935754:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788448351.935765:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448351.935771:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826288896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.935811:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826288896:12345-0@lo:400:kworker.0 Request processed in 40us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.935818:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448351.935840:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288128 00000100:00100000:0.0:1788448351.935843:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288128 00000100:00100000:0.0:1788448351.935863:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288640 00000100:00100000:0.0:1788448351.935866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288640 00000100:00100000:0.0:1788448351.935879:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287488 00000100:00100000:0.0:1788448351.935882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287488 00000100:00100000:0.0:1788448351.935913:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288000 00000100:00100000:0.0:1788448351.935922:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288000 00000100:00100000:0.0:1788448351.935939:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826288512 00000100:00100000:0.0:1788448351.935941:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826288512 00000100:00100000:0.0:1788448351.935952:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287744 00000100:00100000:0.0:1788448351.935955:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287744 00000100:00100000:0.0:1788448351.935966:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448351.935972:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826288128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936007:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826288128:12345-0@lo:400:kworker.0 Request processed in 35us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936012:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448351.936024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788448351.936030:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826288640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936055:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826288640:12345-0@lo:400:kworker.0 Request processed in 26us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936061:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788448351.936072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788448351.936077:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826287488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936103:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826287488:12345-0@lo:400:kworker.0 Request processed in 26us (1059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936109:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788448351.936120:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788448351.936126:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826288000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936151:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826288000:12345-0@lo:400:kworker.0 Request processed in 26us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936157:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788448351.936167:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448351.936172:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826288512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826288512:12345-0@lo:400:kworker.0 Request processed in 33us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936212:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448351.936222:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448351.936228:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826287744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936248:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826287744:12345-0@lo:400:kworker.0 Request processed in 20us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936253:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448351.936277:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287616 00000100:00100000:0.0:1788448351.936280:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287616 00000100:00100000:0.0:1788448351.936295:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287872 00000100:00100000:0.0:1788448351.936297:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287872 00000100:00100000:0.0:1788448351.936307:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788448351.936312:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826287616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936340:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826287616:12345-0@lo:400:kworker.0 Request processed in 28us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936345:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788448351.936355:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788448351.936360:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826287872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936383:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826287872:12345-0@lo:400:kworker.0 Request processed in 23us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448351.936388:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788448351.936423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826287872:0@lo:400:kworker.0 00010000:00080000:0.0:1788448351.936437:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b4700 x1875323826288384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448351.936461:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826288384:0@lo:400:kworker.0 00010000:00080000:0.0:1788448351.936474:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b4000 x1875323826288896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448351.936483:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826288896:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936494:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826287744:0@lo:400:kworker.0 00010000:00080000:0.0:1788448351.936504:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cf800 x1875323826288256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448351.936511:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826288256:0@lo:400:kworker.0 00010000:00080000:0.0:1788448351.936520:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b6a00 x1875323826288768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448351.936529:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826288768:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936576:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826287488:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936587:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826288000:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936596:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826288512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448351.936606:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826287616:0@lo:400:kworker.0 00010000:00080000:0.0:1788448351.936615:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cdc00 x1875323826288128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448351.936623:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826288128:0@lo:400:kworker.0 00010000:00080000:0.0:1788448351.936631:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b5500 x1875323826288640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448351.936645:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826288640:0@lo:400:kworker.0 00000100:00080000:0.0:1788448351.936704:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448351.936709:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448351.936711:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448351.936713:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448351.937461:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826287360 00000100:00100000:1.0:1788448351.937470:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826287360 00000100:00100000:1.0:1788448351.937516:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788448351.937525:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826287360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448351.937596:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826287360:12345-0@lo:400:kworker.0 Request processed in 72us (2272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448351.937602:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788448351.937646:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826287360:0@lo:400:kworker.0 00010000:00010000:2.0:1788448352.257706:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448352.447424:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448352.447445:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826289024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448352.447509:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448352.447607:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289024 00000100:00100000:0.0:1788448352.447615:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289024 00000100:00100000:0.0:1788448352.447671:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788448352.447681:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826289024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448352.447710:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448352.447767:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826289024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448352.447775:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788448352.447832:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e4e00 x1875323826289024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448352.447851:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826289024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448352.448326:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448352.448337:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826289152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448352.448370:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448352.448408:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289152 00000100:00100000:1.0:1788448352.448413:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289152 00000100:00100000:1.0:1788448352.448443:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448352.448450:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826289152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448352.448464:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448352.448495:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826289152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 46us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448352.448501:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788448352.448528:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083688000 x1875323826289152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448352.448541:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826289152:0@lo:13:osp-pre-1-1.0 00000001:02000400:1.0:1788448352.516561:0:11317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:3.0:1788448352.965628:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448352.965662:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826289280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448352.965758:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448352.965943:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289280 00000100:00100000:0.0:1788448352.965954:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289280 00000100:00100000:0.0:1788448352.966016:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788448352.966027:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826289280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448352.966069:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448352.966134:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826289280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448352.966142:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788448352.966294:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826289280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448353.126580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448353.126638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448353.126772:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052544 00000100:00100000:1.0:1788448353.126794:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052544 00000100:00100000:1.0:1788448353.126922:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 283 00000100:00100000:1.0:1788448353.126936:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801052544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448353.127040:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801052544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 107us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448353.127070:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 283 00000100:00100000:3.0:1788448353.130396:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448353.131944:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052800 00000100:00100000:0.0:1788448353.131993:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052800 00000100:00100000:0.0:1788448353.134862:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:0.0:1788448353.134903:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801052800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448353.135279:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801052800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 401us (8637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448353.135288:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00080000:1.0:1788448353.135932:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448353.136453:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052672 00000100:00100000:0.0:1788448353.136758:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052672 00000100:00100000:0.0:1788448353.136863:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:0.0:1788448353.136874:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801052672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:1.0:1788448353.137070:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448353.137264:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801052672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 391us (6881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448353.137273:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 105 00010000:00010000:3.0:1788448353.280440:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448354.302246:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448354.331735:0:11365:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 11:12:32 EDT 2026 00000100:00100000:1.0:1788448355.008837:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826289408:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448355.008923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448355.009009:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289408 00000100:00100000:1.0:1788448355.009017:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289408 00000100:00100000:1.0:1788448355.009067:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448355.009077:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826289408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448355.009105:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448355.009149:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826289408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448355.009157:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788448355.009179:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448355.009209:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b5f80 x1875323826289408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448355.009227:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826289408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448355.009554:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448355.009565:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826289536:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448355.009598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448355.010379:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826289664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448355.010476:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448355.010624:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289664 00000100:00100000:3.0:1788448355.010632:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289664 00000100:00100000:3.0:1788448355.010680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788448355.010689:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826289664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448355.010729:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448355.010783:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826289664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448355.010790:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448355.010868:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289536 00000100:00100000:1.0:1788448355.010873:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289536 00000100:00100000:1.0:1788448355.010936:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788448355.010943:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826289536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448355.010956:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448355.010989:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826289536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448355.010995:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788448355.011120:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448355.011346:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826289664:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1788448355.011360:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b5500 x1875323826289536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448355.011375:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826289536:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788448355.326112:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448356.351262:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448357.054098:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826289792:0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.054165:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448357.054435:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826290304:0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.054937:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448357.054971:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826290816:0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.055054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448357.055079:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826291328:0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.055102:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448357.055127:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788448357.055133:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826289920:0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.055159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448357.055177:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826290432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.055197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448357.056458:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290304 00000100:00100000:1.0:1788448357.056470:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290304 00000100:00100000:1.0:1788448357.056526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788448357.056537:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826290304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448357.056605:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826290304:12345-0@lo:400:kworker.0 Request processed in 70us (1669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448357.056613:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788448357.056766:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289792 00000100:00100000:2.0:1788448357.056771:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289792 00000100:00100000:2.0:1788448357.056797:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788448357.056803:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.056839:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826289792:12345-0@lo:400:kworker.0 Request processed in 36us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.056845:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1788448357.057953:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290816 00000100:00100000:2.0:1788448357.057963:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290816 00000100:00100000:2.0:1788448357.058018:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291328 00000100:00100000:2.0:1788448357.058022:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291328 00000100:00100000:2.0:1788448357.058046:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448357.058055:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058115:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826290816:12345-0@lo:400:kworker.0 Request processed in 61us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.058122:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448357.058137:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448357.058143:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826291328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058170:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826291328:12345-0@lo:400:kworker.0 Request processed in 28us (3067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.058183:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448357.058211:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826290176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058275:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.058302:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826290688:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058325:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.058343:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826291200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.058378:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788448357.058384:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826290048:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058496:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.058518:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826290560:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058546:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.058564:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826291072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058586:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.058615:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290688 00000100:00100000:2.0:1788448357.058619:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290688 00000100:00100000:2.0:1788448357.058638:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291200 00000100:00100000:2.0:1788448357.058641:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291200 00000100:00100000:2.0:1788448357.058655:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448357.058661:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058695:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826290688:12345-0@lo:400:kworker.0 Request processed in 34us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.058701:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448357.058711:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448357.058717:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826291200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058764:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826291200:12345-0@lo:400:kworker.0 Request processed in 36us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.058770:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448357.058792:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826289920 00000100:00100000:2.0:1788448357.058796:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826289920 00000100:00100000:2.0:1788448357.058813:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290432 00000100:00100000:2.0:1788448357.058816:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290432 00000100:00100000:2.0:1788448357.058827:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290176 00000100:00100000:2.0:1788448357.058830:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290176 00000100:00100000:2.0:1788448357.058840:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290560 00000100:00100000:2.0:1788448357.058842:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290560 00000100:00100000:2.0:1788448357.058852:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291072 00000100:00100000:2.0:1788448357.058854:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291072 00000100:00100000:2.0:1788448357.058865:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788448357.058871:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058928:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826289920:12345-0@lo:400:kworker.0 Request processed in 58us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.058934:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788448357.058945:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788448357.058951:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.058978:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826290432:12345-0@lo:400:kworker.0 Request processed in 28us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.058984:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788448357.058995:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788448357.059002:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826290176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448357.059017:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826290944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059043:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826290176:12345-0@lo:400:kworker.0 Request processed in 42us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448357.059044:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448357.059058:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788448357.059067:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290944 00000100:00100000:3.0:1788448357.059068:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826289792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059069:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290944 00000100:00100000:3.0:1788448357.059082:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826290304:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059084:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788448357.059089:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826290560:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788448357.059095:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796d80 x1875323826290816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448357.059112:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826290816:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059115:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826290560:12345-0@lo:400:kworker.0 Request processed in 26us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.059119:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1788448357.059124:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb795c00 x1875323826291328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448357.059128:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788448357.059132:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826291328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059134:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826291072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059156:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826291072:12345-0@lo:400:kworker.0 Request processed in 22us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448357.059158:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826289920:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059161:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788448357.059167:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826290432:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059170:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788448357.059176:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826290944:12345-0@lo:400:kworker.0 Request processed in 33us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448357.059215:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788448357.059226:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826290944:0@lo:400:kworker.0 00010000:00080000:2.0:1788448357.059245:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796300 x1875323826290560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448357.059254:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826290560:0@lo:400:kworker.0 00010000:00080000:2.0:1788448357.059263:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797b80 x1875323826291072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448357.059271:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826291072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448357.059290:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826290176:0@lo:400:kworker.0 00010000:00080000:2.0:1788448357.059300:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797800 x1875323826290688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448357.059308:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826290688:0@lo:400:kworker.0 00010000:00080000:2.0:1788448357.059316:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb794380 x1875323826291200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448357.059324:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826291200:0@lo:400:kworker.0 00000100:00080000:1.0:1788448357.059415:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448357.059420:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448357.059423:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448357.059435:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448357.059446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826290048 00000100:00100000:1.0:1788448357.059450:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826290048 00000100:00100000:1.0:1788448357.059488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788448357.059495:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826290048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448357.059537:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826290048:12345-0@lo:400:kworker.0 Request processed in 43us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448357.059543:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788448357.059595:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826290048:0@lo:400:kworker.0 00010000:00010000:2.0:1788448357.374431:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448357.567843:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448357.567865:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826291456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448357.573484:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448357.573712:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291456 00000100:00100000:1.0:1788448357.573720:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291456 00000100:00100000:1.0:1788448357.573778:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448357.573787:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826291456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448357.573812:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448357.573870:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826291456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448357.573877:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448357.573916:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448357.573938:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826291584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448357.573972:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448357.573998:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291584 00000100:00100000:1.0:1788448357.574001:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291584 00000100:00100000:1.0:1788448357.574023:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788448357.574029:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826291584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448357.574039:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448357.574067:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826291584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (94us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448357.574073:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788448357.574106:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7c8000 x1875323826291584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448357.574123:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826291584:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788448357.574155:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137d500 x1875323826291456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448357.574166:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826291456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448358.079049:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826291712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448358.079127:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448358.079240:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291712 00000100:00100000:3.0:1788448358.079248:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291712 00000100:00100000:3.0:1788448358.079300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788448358.079309:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826291712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448358.079341:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788448358.079397:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826291712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448358.079404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788448358.079528:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826291712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448358.246052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448358.246100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448358.246175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448358.246386:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053184 00000100:00100000:3.0:1788448358.246396:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053184 00000100:00100000:3.0:1788448358.246499:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053056 00000100:00100000:3.0:1788448358.246503:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053056 00000100:00100000:3.0:1788448358.246528:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:3.0:1788448358.246538:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801053184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448358.246610:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801053184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 74us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448358.246632:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:3.0:1788448358.246649:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:3.0:1788448358.246655:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801053056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448358.246681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801053056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448358.246686:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00080000:2.0:1788448358.247294:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448358.247299:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448358.247576:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801052928 00000100:00100000:1.0:1788448358.247582:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801052928 00000100:00100000:2.0:1788448358.247649:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 285 00000100:00100000:2.0:1788448358.247659:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801052928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448358.247805:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2399:x1875323801052928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 147us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448358.247813:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 285 00010000:00010000:3.0:1788448358.401377:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448359.423998:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448360.126021:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448360.126079:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826291840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448360.126146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448360.126225:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291840 00000100:00100000:2.0:1788448360.126233:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291840 00000100:00100000:2.0:1788448360.126321:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788448360.126331:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826291840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448360.126372:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448360.126415:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826291840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448360.126422:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788448360.126456:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448360.126483:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823fbb80 x1875323826291840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448360.126501:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826291840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448360.126857:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448360.126868:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826291968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448360.126921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448360.126953:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826291968 00000100:00100000:1.0:1788448360.126959:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826291968 00000100:00100000:1.0:1788448360.126987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788448360.127003:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826291968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448360.127026:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788448360.127063:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826291968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 62us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448360.127068:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788448360.127099:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826291968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448360.127191:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448360.127199:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826292096:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448360.127227:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448360.127259:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292096 00000100:00100000:0.0:1788448360.127263:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292096 00000100:00100000:0.0:1788448360.127290:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448360.127296:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826292096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448360.127317:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448360.127349:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826292096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448360.127362:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788448360.127391:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5880 x1875323826292096/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448360.127404:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826292096:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788448360.127850:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448360.449697:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448361.484326:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448362.175116:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826292480:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175185:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.175232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826292992:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175255:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.175272:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826293504:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175289:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.175313:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788448362.175318:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.175353:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826292864:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175371:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.175384:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826293376:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175403:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.175431:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292992 00000100:00100000:0.0:1788448362.175438:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292992 00000100:00100000:0.0:1788448362.175477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293504 00000100:00100000:0.0:1788448362.175480:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293504 00000100:00100000:0.0:1788448362.175494:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292352 00000100:00100000:0.0:1788448362.175496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292352 00000100:00100000:0.0:1788448362.175505:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292864 00000100:00100000:0.0:1788448362.175507:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292864 00000100:00100000:0.0:1788448362.175534:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293376 00000100:00100000:0.0:1788448362.175537:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293376 00000100:00100000:0.0:1788448362.175550:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788448362.175558:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826292992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175605:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826292992:12345-0@lo:400:kworker.0 Request processed in 48us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448362.175612:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788448362.175629:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788448362.175634:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826293504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175660:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826293504:12345-0@lo:400:kworker.0 Request processed in 26us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448362.175665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788448362.175677:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788448362.175697:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826292352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175735:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826292352:12345-0@lo:400:kworker.0 Request processed in 42us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448362.175741:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788448362.175752:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788448362.175758:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826292864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175783:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826292864:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448362.175789:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788448362.175799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788448362.175805:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826293376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175825:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826293376:12345-0@lo:400:kworker.0 Request processed in 21us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448362.175837:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:0.0:1788448362.175863:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448362.175866:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448362.175912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826292352:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175922:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826292864:0@lo:400:kworker.0 00000100:00100000:0.0:1788448362.175930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826293376:0@lo:400:kworker.0 00010000:00080000:0.0:1788448362.175942:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fa300 x1875323826292992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448362.175952:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826292992:0@lo:400:kworker.0 00010000:00080000:0.0:1788448362.175960:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f9f80 x1875323826293504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448362.175967:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826293504:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178255:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178326:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178374:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826292736:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178404:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178425:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826293248:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178449:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178469:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178530:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788448362.178538:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826293120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178602:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178618:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826293632:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178637:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448362.178679:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292480 00000100:00100000:1.0:1788448362.178686:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292480 00000100:00100000:1.0:1788448362.178722:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292736 00000100:00100000:1.0:1788448362.178735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292736 00000100:00100000:1.0:1788448362.178763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788448362.178772:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826292480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178830:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826292480:12345-0@lo:400:kworker.0 Request processed in 58us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.178837:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788448362.178855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788448362.178862:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826292736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.178910:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826292736:12345-0@lo:400:kworker.0 Request processed in 48us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.178916:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788448362.178937:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293248 00000100:00100000:1.0:1788448362.178940:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293248 00000100:00100000:1.0:1788448362.178968:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293760 00000100:00100000:1.0:1788448362.178971:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293760 00000100:00100000:1.0:1788448362.178983:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293120 00000100:00100000:1.0:1788448362.178986:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293120 00000100:00100000:1.0:1788448362.178997:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293632 00000100:00100000:1.0:1788448362.179000:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293632 00000100:00100000:1.0:1788448362.179014:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448362.179020:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826293248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179048:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826293248:12345-0@lo:400:kworker.0 Request processed in 29us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.179054:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448362.179066:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788448362.179072:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826293760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179097:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826293760:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.179102:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788448362.179122:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788448362.179129:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826293120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179156:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826293120:12345-0@lo:400:kworker.0 Request processed in 28us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.179162:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788448362.179173:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788448362.179179:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826293632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179203:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826293632:12345-0@lo:400:kworker.0 Request processed in 25us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.179209:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1788448362.179231:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448362.179235:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448362.179245:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292608 00000100:00100000:1.0:1788448362.179249:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292608 00000100:00100000:1.0:1788448362.179271:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788448362.179277:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826292608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179303:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826292608:12345-0@lo:400:kworker.0 Request processed in 26us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448362.179309:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788448362.179341:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826292608:0@lo:400:kworker.0 00010000:00080000:1.0:1788448362.179355:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fbb80 x1875323826293120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448362.179365:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826293120:0@lo:400:kworker.0 00010000:00080000:1.0:1788448362.179374:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fad80 x1875323826293632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448362.179396:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826293632:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179408:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826292736:0@lo:400:kworker.0 00010000:00080000:1.0:1788448362.179417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f9880 x1875323826293248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448362.179425:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826293248:0@lo:400:kworker.0 00010000:00080000:1.0:1788448362.179433:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f8700 x1875323826293760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448362.179440:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826293760:0@lo:400:kworker.0 00000100:00100000:1.0:1788448362.179477:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826292480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448362.180332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826292224 00000100:00100000:3.0:1788448362.180339:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826292224 00000100:00100000:3.0:1788448362.180382:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788448362.180390:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826292224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448362.180454:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826292224:12345-0@lo:400:kworker.0 Request processed in 66us (2128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448362.180461:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788448362.182628:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826292224:0@lo:400:kworker.0 00010000:00010000:3.0:1788448362.494194:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448362.689292:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826293888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448362.689357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448362.689437:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826293888 00000100:00100000:3.0:1788448362.689444:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826293888 00000100:00100000:3.0:1788448362.689486:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448362.689496:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826293888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448362.689523:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448362.689567:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826293888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448362.689583:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788448362.689620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4895180 x1875323826293888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448362.689636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826293888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448362.689769:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448362.689777:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448362.689804:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448362.689832:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294016 00000100:00100000:0.0:1788448362.689835:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294016 00000100:00100000:0.0:1788448362.689859:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448362.689867:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826294016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448362.689877:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448362.689935:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826294016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448362.689953:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788448362.689982:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f9f80 x1875323826294016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448362.689997:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448363.198063:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448363.198083:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826294144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448363.198152:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448363.198215:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294144 00000100:00100000:0.0:1788448363.198222:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294144 00000100:00100000:0.0:1788448363.198280:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788448363.198288:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826294144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448363.198318:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448363.198753:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826294144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 464us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448363.198762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788448363.198876:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826294144:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448363.370473:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448363.370509:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448363.370548:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448363.370578:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053312 00000100:00100000:3.0:1788448363.370588:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053312 00000100:00100000:3.0:1788448363.370638:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:3.0:1788448363.370648:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801053312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448363.370715:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2400:x1875323801053312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448363.370735:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:3.0:1788448363.370770:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053568 00000100:00100000:3.0:1788448363.370774:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053568 00000100:00100000:3.0:1788448363.370814:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053440 00000100:00100000:3.0:1788448363.370818:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053440 00000100:00100000:3.0:1788448363.370858:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:3.0:1788448363.370866:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801053568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448363.370912:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801053568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448363.370918:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:3.0:1788448363.370931:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:3.0:1788448363.370937:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801053440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448363.370969:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801053440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448363.370976:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00080000:1.0:1788448363.373371:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448363.373380:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788448363.518007:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448364.543164:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448365.246163:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448365.246186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826294272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448365.246258:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448365.246329:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294272 00000100:00100000:0.0:1788448365.246337:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294272 00000100:00100000:0.0:1788448365.246386:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788448365.246407:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826294272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448365.246432:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448365.246470:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826294272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448365.246493:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1788448365.246534:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836f9f80 x1875323826294272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448365.246550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826294272:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788448365.246707:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448365.246955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826294400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448365.246988:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448365.247060:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294400 00000100:00100000:0.0:1788448365.247065:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294400 00000100:00100000:0.0:1788448365.247100:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788448365.247107:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826294400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448365.247127:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448365.247160:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826294400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 53us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448365.247165:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788448365.247232:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826294400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448365.249759:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448365.249781:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826294528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448365.249856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448365.249960:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294528 00000100:00100000:1.0:1788448365.249968:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294528 00000100:00100000:1.0:1788448365.250028:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448365.250037:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826294528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448365.250055:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448365.250095:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826294528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448365.250107:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1788448365.250143:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7ca300 x1875323826294528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448365.250159:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826294528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788448365.251316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448365.571005:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448366.595450:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448367.306424:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826294784:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306542:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826295296:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306563:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306601:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826295808:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306647:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788448367.306653:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826294656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306679:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306709:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826295168:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306733:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306751:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826295680:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306773:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306789:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826296192:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306807:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306833:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826294912:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306904:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826295424:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.306976:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.306990:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788448367.306995:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826295040:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.307027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826295552:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.307079:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448367.307129:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294784 00000100:00100000:1.0:1788448367.307136:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294784 00000100:00100000:1.0:1788448367.307172:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295296 00000100:00100000:1.0:1788448367.307175:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295296 00000100:00100000:1.0:1788448367.307196:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295808 00000100:00100000:1.0:1788448367.307199:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295808 00000100:00100000:1.0:1788448367.307211:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295424 00000100:00100000:1.0:1788448367.307214:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295424 00000100:00100000:1.0:1788448367.307225:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295936 00000100:00100000:1.0:1788448367.307227:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295936 00000100:00100000:1.0:1788448367.307237:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295040 00000100:00100000:1.0:1788448367.307239:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295040 00000100:00100000:1.0:1788448367.307254:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788448367.307263:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826294784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307316:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826294784:12345-0@lo:400:kworker.0 Request processed in 53us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307323:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788448367.307339:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788448367.307345:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826295296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307383:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826295296:12345-0@lo:400:kworker.0 Request processed in 39us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307389:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788448367.307400:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788448367.307406:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826295808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307431:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826295808:12345-0@lo:400:kworker.0 Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307437:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788448367.307448:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788448367.307454:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826295424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307485:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826295424:12345-0@lo:400:kworker.0 Request processed in 32us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307491:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788448367.307501:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788448367.307508:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826295936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307533:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826295936:12345-0@lo:400:kworker.0 Request processed in 27us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307539:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788448367.307550:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448367.307556:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826295040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307582:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826295040:12345-0@lo:400:kworker.0 Request processed in 26us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307588:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448367.307613:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294656 00000100:00100000:1.0:1788448367.307618:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294656 00000100:00100000:1.0:1788448367.307653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788448367.307659:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826294656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307688:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826294656:12345-0@lo:400:kworker.0 Request processed in 30us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307694:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788448367.307731:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295168 00000100:00100000:1.0:1788448367.307735:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295168 00000100:00100000:1.0:1788448367.307750:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826294912 00000100:00100000:1.0:1788448367.307752:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826294912 00000100:00100000:1.0:1788448367.307762:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788448367.307768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826295168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307795:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826295168:12345-0@lo:400:kworker.0 Request processed in 27us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307800:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788448367.307812:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788448367.307819:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826294912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307843:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826294912:12345-0@lo:400:kworker.0 Request processed in 26us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.307848:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788448367.307866:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295680 00000100:00100000:1.0:1788448367.307869:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295680 00000100:00100000:1.0:1788448367.307913:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296192 00000100:00100000:1.0:1788448367.307916:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296192 00000100:00100000:1.0:1788448367.307928:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826295552 00000100:00100000:1.0:1788448367.307930:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826295552 00000100:00100000:1.0:1788448367.307939:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296064 00000100:00100000:1.0:1788448367.307941:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296064 00000100:00100000:1.0:1788448367.307951:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448367.307957:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826295680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.307995:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826295680:12345-0@lo:400:kworker.0 Request processed in 38us (1222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.308002:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448367.308013:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788448367.308020:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826296192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308044:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826296192:12345-0@lo:400:kworker.0 Request processed in 25us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.308050:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788448367.308061:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788448367.308066:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826295552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308100:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826295552:12345-0@lo:400:kworker.0 Request processed in 34us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.308107:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788448367.308116:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448367.308121:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826296064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308140:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826296064:12345-0@lo:400:kworker.0 Request processed in 19us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448367.308144:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448367.308194:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826295040:0@lo:400:kworker.0 00010000:00080000:1.0:1788448367.308205:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137d500 x1875323826295552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448367.308215:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826295552:0@lo:400:kworker.0 00010000:00080000:1.0:1788448367.308223:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0a80 x1875323826296064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448367.308245:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308257:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826294912:0@lo:400:kworker.0 00010000:00080000:1.0:1788448367.308265:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb425180 x1875323826295424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448367.308274:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826295424:0@lo:400:kworker.0 00010000:00080000:1.0:1788448367.308282:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0e00 x1875323826295936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448367.308290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826295936:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308327:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826294656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308337:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826295168:0@lo:400:kworker.0 00010000:00080000:1.0:1788448367.308346:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e1f80 x1875323826295680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448367.308353:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826295680:0@lo:400:kworker.0 00010000:00080000:1.0:1788448367.308361:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e3480 x1875323826296192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448367.308369:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826296192:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308378:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826294784:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308388:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826295296:0@lo:400:kworker.0 00000100:00100000:1.0:1788448367.308396:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826295808:0@lo:400:kworker.0 00000100:00080000:1.0:1788448367.309648:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448367.309654:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448367.309657:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448367.309659:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448367.614038:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448367.806349:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448367.806372:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448367.806439:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448367.806546:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296320 00000100:00100000:0.0:1788448367.806554:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296320 00000100:00100000:0.0:1788448367.806611:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448367.806621:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826296320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448367.806663:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448367.806725:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826296320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448367.806733:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788448367.806784:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823fbb80 x1875323826296320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448367.806818:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826296320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448367.810343:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448367.810365:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826296448:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448367.810429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448367.810483:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296448 00000100:00100000:2.0:1788448367.810490:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296448 00000100:00100000:2.0:1788448367.810543:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788448367.810553:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826296448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448367.810574:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448367.810618:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826296448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448367.810624:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788448367.811142:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823fb100 x1875323826296448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448367.811174:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826296448:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448368.317999:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448368.318024:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826296576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448368.318094:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.318155:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296576 00000100:00100000:1.0:1788448368.318162:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296576 00000100:00100000:1.0:1788448368.318204:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788448368.318214:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186ba2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826296576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448368.318247:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448368.318293:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186ba2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826296576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.318300:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788448368.318602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826296576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448368.496734:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448368.497713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448368.497741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448368.498700:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053952 00000100:00100000:1.0:1788448368.498712:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053952 00000100:00100000:1.0:1788448368.498786:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053824 00000100:00100000:1.0:1788448368.498791:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053824 00000100:00100000:1.0:1788448368.498818:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:1.0:1788448368.498829:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801053952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448368.498932:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801053952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 105us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.498940:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:1.0:1788448368.498958:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:1.0:1788448368.498966:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801053824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448368.499004:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801053824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.499011:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00080000:1.0:1788448368.499033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448368.499037:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448368.510139:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801053696 00000100:00100000:3.0:1788448368.510155:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801053696 00000100:00100000:3.0:1788448368.510260:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 289 00000100:00100000:3.0:1788448368.510271:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801053696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448368.510344:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801053696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (13620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.510352:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 289 00010000:00010000:2.0:1788448368.642605:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448369.662148:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448370.366270:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826296704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448370.366338:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448370.366585:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296704 00000100:00100000:3.0:1788448370.366593:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296704 00000100:00100000:3.0:1788448370.366656:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448370.366668:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826296704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448370.366706:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448370.366752:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826296704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448370.366759:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788448370.366864:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fad80 x1875323826296704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448370.366920:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826296704:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788448370.367234:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448370.367550:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448370.367560:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826296832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448370.367603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448370.368497:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296832 00000100:00100000:2.0:1788448370.368503:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296832 00000100:00100000:2.0:1788448370.368561:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788448370.368569:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826296832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448370.368585:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448370.368628:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826296832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448370.368634:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788448370.368664:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9500 x1875323826296832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448370.368678:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826296832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448370.368793:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448370.368803:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826296960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448370.368841:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448370.369228:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826296960 00000100:00100000:1.0:1788448370.369234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826296960 00000100:00100000:1.0:1788448370.369266:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788448370.369273:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826296960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448370.369304:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788448370.369360:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826296960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448370.369366:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788448370.369517:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826296960:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788448370.370068:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448370.693787:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448371.663476:0:11994:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:12:49 (1788448369) === 00010000:00010000:3.0:1788448371.711113:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448372.182578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.182682:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054080 00000100:00100000:1.0:1788448372.182691:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054080 00000100:00100000:1.0:1788448372.182746:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 290 00000100:00100000:1.0:1788448372.182757:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:8729:x1875323801054080:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448372.182775:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448372.182793:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b8037e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e04e2 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448372.182822:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b8037e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04e2 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448372.182833:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b8037e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04e2 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448372.182842:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8a00, rc 0) 00000100:00100000:1.0:1788448372.182953:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8729:x1875323801054080:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 197us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.182968:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 290 00000100:00100000:3.0:1788448372.195250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.198325:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054208 00000100:00100000:0.0:1788448372.198340:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054208 00000100:00100000:0.0:1788448372.198410:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 291 00000100:00100000:0.0:1788448372.198422:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8729:x1875323801054208:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448372.198586:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8729:x1875323801054208:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 165us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.198594:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 291 00000100:00100000:0.0:1788448372.211415:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.212293:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054336 00000100:00100000:1.0:1788448372.212305:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054336 00000100:00100000:1.0:1788448372.212403:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 292 00000100:00100000:1.0:1788448372.212413:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8729:x1875323801054336:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788448372.212573:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8729:x1875323801054336:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 161us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.212582:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 292 00000100:00100000:2.0:1788448372.217809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.217926:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054464 00000100:00100000:0.0:1788448372.217936:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054464 00000100:00100000:0.0:1788448372.217983:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 293 00000100:00100000:0.0:1788448372.217994:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8733:x1875323801054464:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448372.218406:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8733:x1875323801054464:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 412us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.218415:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 293 00000100:00100000:0.0:1788448372.253822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.255113:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054592 00000100:00100000:1.0:1788448372.255125:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054592 00000100:00100000:1.0:1788448372.255183:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 294 00000100:00100000:1.0:1788448372.255194:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8733:x1875323801054592:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448372.256255:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8733:x1875323801054592:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 1057us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.256265:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 294 00000100:00100000:3.0:1788448372.262918:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.263240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054720 00000100:00100000:0.0:1788448372.263250:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054720 00000100:00100000:0.0:1788448372.263312:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:0.0:1788448372.263331:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8733:x1875323801054720:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448372.263490:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8733:x1875323801054720:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 158us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.263498:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:2.0:1788448372.280507:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.280846:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054848 00000100:00100000:1.0:1788448372.280856:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054848 00000100:00100000:1.0:1788448372.280940:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 296 00000100:00100000:1.0:1788448372.280951:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:8729:x1875323801054848:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448372.280967:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448372.280984:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b8037e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0513 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448372.281012:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b8037e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0513 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448372.281039:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b8037e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0513 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448372.281049:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9200, rc 0) 00000100:00100000:1.0:1788448372.281119:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:8729:x1875323801054848:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 169us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.281127:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 296 00000100:00100000:1.0:1788448372.288442:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448372.288667:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801054976 00000100:00100000:3.0:1788448372.288686:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801054976 00000100:00100000:3.0:1788448372.288738:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00100000:3.0:1788448372.288747:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:8729:x1875323801054976:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788448372.288770:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788448372.288794:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788448372.288798:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788448372.288802:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788448372.288805:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788448372.288807:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788448372.298345:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:8729:x1875323801054976:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 9588us (9903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.298360:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00100000:2.0:1788448372.307019:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.307169:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055104 00000100:00100000:0.0:1788448372.307177:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055104 00000100:00100000:0.0:1788448372.307232:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 298 00000100:00100000:0.0:1788448372.307247:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:8729:x1875323801055104:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448372.307262:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448372.307291:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e051a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448372.307318:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448372.307330:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448372.307339:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448372.307395:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8729:x1875323801055104:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 150us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.307402:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 298 00000100:00100000:1.0:1788448372.313419:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.313757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055232 00000100:00100000:0.0:1788448372.313766:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055232 00000100:00100000:0.0:1788448372.313837:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 299 00000100:00100000:0.0:1788448372.313848:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8729:x1875323801055232:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448372.314534:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8729:x1875323801055232:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 685us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.314544:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 299 00000100:00100000:3.0:1788448372.318520:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.322496:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055360 00000100:00100000:1.0:1788448372.322509:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055360 00000100:00100000:1.0:1788448372.322690:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 300 00000100:00100000:1.0:1788448372.322700:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8729:x1875323801055360:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788448372.322870:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8729:x1875323801055360:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 171us (4370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.322895:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 300 00000100:00100000:2.0:1788448372.330688:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.330973:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055488 00000100:00100000:0.0:1788448372.330983:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055488 00000100:00100000:0.0:1788448372.331042:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 301 00000100:00100000:0.0:1788448372.331052:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8738:x1875323801055488:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448372.331206:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8738:x1875323801055488:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 155us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.331213:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 301 00000100:00100000:2.0:1788448372.338764:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.338853:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055616 00000100:00100000:1.0:1788448372.338861:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055616 00000100:00100000:1.0:1788448372.338931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 302 00000100:00100000:1.0:1788448372.338940:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8738:x1875323801055616:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448372.339089:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:8738:x1875323801055616:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 149us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.339098:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 302 00000100:00100000:3.0:1788448372.344435:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.344596:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055744 00000100:00100000:1.0:1788448372.344620:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055744 00000100:00100000:1.0:1788448372.344685:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:1.0:1788448372.344693:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875323801055744:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788448372.344724:0:9023:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 66d43c2c-d252-43d9-8f04-1c7a728a06f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1788448372.344761:0:9023:0:(genops.c:1385:class_connect()) connect: client 66d43c2c-d252-43d9-8f04-1c7a728a06f0, cookie 0xf45a9e4e6b8037f6 00000004:00100000:1.0:1788448372.344784:0:9023:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788448372.344940:0:9023:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ac000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448372.345017:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2397:x1875323801055744:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 322us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.345025:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448372.347794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448372.347829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448372.347962:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801055872 00000100:00100000:3.0:1788448372.347972:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801055872 00000100:00100000:3.0:1788448372.348047:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056000 00000100:00100000:3.0:1788448372.348050:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056000 00000100:00100000:3.0:1788448372.348072:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:3.0:1788448372.348081:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801055872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448372.348156:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801055872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448372.348163:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:3.0:1788448372.348180:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:3.0:1788448372.348186:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801056000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448372.348227:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801056000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448372.348233:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00080000:0.0:1788448372.348418:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448372.348423:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448372.356943:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.357131:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056512 00000100:00100000:1.0:1788448372.357141:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056512 00000100:00100000:1.0:1788448372.357212:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:1.0:1788448372.357230:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801056512:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788448372.357270:0:6517:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448372.357370:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801056512:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 147us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.357377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00080000:0.0:1788448372.357491:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448372.361782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448372.361827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.362488:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056128 00000100:00100000:1.0:1788448372.362499:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056128 00000100:00100000:1.0:1788448372.362559:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056256 00000100:00100000:1.0:1788448372.362563:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056256 00000100:00100000:1.0:1788448372.362595:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1788448372.362605:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801056128:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788448372.362635:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448372.362702:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801056128:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 98us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.362722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1788448372.362739:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1788448372.362744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2397:x1875323801056256:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788448372.362766:0:6518:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 66d43c2c-d252-43d9-8f04-1c7a728a06f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1788448372.362798:0:6518:0:(genops.c:1385:class_connect()) connect: client 66d43c2c-d252-43d9-8f04-1c7a728a06f0, cookie 0xf45a9e4e6b8037fd 00000004:00100000:1.0:1788448372.362820:0:6518:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788448372.363081:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448372.363113:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2397:x1875323801056256:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 366us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.363121:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448372.365438:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448372.366275:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056640 00000100:00100000:1.0:1788448372.366300:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056640 00000100:00100000:1.0:1788448372.366366:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448372.366385:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801056640:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788448372.366463:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801056640:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 88us (1034us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.366470:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448372.370015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448372.370060:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.370208:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056384 00000100:00100000:0.0:1788448372.370217:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056384 00000100:00100000:0.0:1788448372.370302:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1788448372.370313:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:0:x1875323801056384:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448372.370348:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448372.370437:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:0:x1875323801056384:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 125us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.370444:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00080000:2.0:1788448372.370523:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448372.370974:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057024 00000100:00100000:1.0:1788448372.370980:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057024 00000100:00100000:1.0:1788448372.371023:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1788448372.371031:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801057024:12345-192.168.206.21@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788448372.371075:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801057024:12345-192.168.206.21@tcp:900:mount.lustre.0 Request processed in 45us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.371081:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:2.0:1788448372.377925:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448372.377988:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448372.378037:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448372.378176:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057152 00000100:00100000:0.0:1788448372.378186:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057152 00000100:00100000:0.0:1788448372.378242:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:0.0:1788448372.378258:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801057152:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788448372.378353:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788448372.378448:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:8729:x1875323801057152:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 191us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.378455:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1788448372.379020:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056768 00000100:00100000:3.0:1788448372.379026:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056768 00000100:00100000:3.0:1788448372.379053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801056896 00000100:00100000:3.0:1788448372.379056:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801056896 00000100:00100000:3.0:1788448372.379070:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448372.379076:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2397:x1875323801056768:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788448372.379100:0:8431:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 66d43c2c-d252-43d9-8f04-1c7a728a06f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1788448372.379137:0:8431:0:(genops.c:1385:class_connect()) connect: client 66d43c2c-d252-43d9-8f04-1c7a728a06f0, cookie 0xf45a9e4e6b803804 00002000:00100000:3.0:1788448372.379148:0:8431:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 66d43c2c-d252-43d9-8f04-1c7a728a06f0/ffff9fc083570000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788448372.379164:0:8431:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788448372.379258:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:1.0:1788448372.379264:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875323801056896:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788448372.379281:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 66d43c2c-d252-43d9-8f04-1c7a728a06f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:1.0:1788448372.379300:0:8434:0:(genops.c:1385:class_connect()) connect: client 66d43c2c-d252-43d9-8f04-1c7a728a06f0, cookie 0xf45a9e4e6b80380b 00002000:00100000:1.0:1788448372.379305:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 66d43c2c-d252-43d9-8f04-1c7a728a06f0/ffff9fc0835a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448372.379316:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788448372.379359:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788448372.379398:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448372.379442:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2397:x1875323801056896:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 176us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.379449:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00002000:00080000:3.0:1788448372.379738:0:8431:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788448372.379754:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9fc083575000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448372.379779:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2397:x1875323801056768:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 702us (1864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448372.379786:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448372.414293:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826297344:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.414358:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.414410:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826297856:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.414436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.414454:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826298368:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.414474:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.414499:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788448372.414505:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826297216:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.414525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.414539:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826297728:0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.414668:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297344 00000100:00100000:0.0:1788448372.414686:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297344 00000100:00100000:0.0:1788448372.414730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448372.414739:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826297344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448372.414825:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788448372.419976:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826297088:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.423011:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.423071:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826298240:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.423100:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.423220:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297856 00000100:00100000:1.0:1788448372.423229:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297856 00000100:00100000:1.0:1788448372.423283:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298368 00000100:00100000:1.0:1788448372.423286:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298368 00000100:00100000:1.0:1788448372.423300:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297216 00000100:00100000:1.0:1788448372.423303:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297216 00000100:00100000:1.0:1788448372.423313:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297728 00000100:00100000:1.0:1788448372.423315:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297728 00000100:00100000:1.0:1788448372.423326:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298240 00000100:00100000:1.0:1788448372.423329:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298240 00000100:00100000:1.0:1788448372.423345:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788448372.423353:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826297856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.423406:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826297856:12345-0@lo:400:kworker.0 Request processed in 53us (8970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.423414:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788448372.423429:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788448372.423435:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826298368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.423462:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826298368:12345-0@lo:400:kworker.0 Request processed in 27us (8986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.423468:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788448372.423479:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788448372.423484:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826297216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.423512:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826297216:12345-0@lo:400:kworker.0 Request processed in 27us (8986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.423517:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788448372.423527:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788448372.423532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826297728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.423683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826297344:12345-0@lo:400:kworker.0 Request processed in 8933us (9314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.423691:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448372.423737:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788448372.423744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826298240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.423769:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826298240:12345-0@lo:400:kworker.0 Request processed in 27us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.423774:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788448372.423969:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826297216:0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.423981:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826298240:0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.423990:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826297344:0@lo:400:kworker.0 00010000:00080000:0.0:1788448372.424003:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0a80 x1875323826297856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448372.424013:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826297856:0@lo:400:kworker.0 00010000:00080000:0.0:1788448372.424023:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cf800 x1875323826298368/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448372.424039:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826298368:0@lo:400:kworker.0 00000100:00080000:0.0:1788448372.424088:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448372.424093:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448372.424204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448372.424237:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826297984:0@lo:400:kworker.0 00000100:00100000:2.0:1788448372.424259:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448372.424280:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826298496:0@lo:400:kworker.0 00000100:00100000:2.0:1788448372.424299:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448372.425991:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826297728:12345-0@lo:400:kworker.0 Request processed in 2452us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.426016:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788448372.426046:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297472 00000100:00100000:1.0:1788448372.426053:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297472 00000100:00100000:1.0:1788448372.426096:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788448372.426103:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826297472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.426260:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297984 00000100:00100000:0.0:1788448372.426265:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297984 00000100:00100000:0.0:1788448372.426299:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298496 00000100:00100000:0.0:1788448372.426303:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298496 00000100:00100000:0.0:1788448372.426320:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448372.426327:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826297984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.426364:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826297984:12345-0@lo:400:kworker.0 Request processed in 38us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.426370:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448372.426383:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788448372.426389:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826298496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.426413:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826298496:12345-0@lo:400:kworker.0 Request processed in 25us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.426419:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788448372.426438:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448372.426441:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448372.426535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448372.426583:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826297600:0@lo:400:kworker.0 00000100:00100000:3.0:1788448372.426608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448372.426621:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826298112:0@lo:400:kworker.0 00000100:00100000:3.0:1788448372.426638:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448372.426648:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826298624:0@lo:400:kworker.0 00000100:00100000:3.0:1788448372.426661:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448372.426978:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826297728:0@lo:400:kworker.0 00010000:00080000:2.0:1788448372.427012:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0000 x1875323826297984/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448372.427023:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826297984:0@lo:400:kworker.0 00010000:00080000:2.0:1788448372.427034:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cdf80 x1875323826298496/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448372.427041:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826298496:0@lo:400:kworker.0 00000100:00100000:1.0:1788448372.428713:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826297472:12345-0@lo:400:kworker.0 Request processed in 2603us (4501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448372.428726:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788448372.429964:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298112 00000100:00100000:0.0:1788448372.429976:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298112 00000100:00100000:0.0:1788448372.430053:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298624 00000100:00100000:0.0:1788448372.430057:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298624 00000100:00100000:0.0:1788448372.430083:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448372.430093:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826298112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.430178:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826298112:12345-0@lo:400:kworker.0 Request processed in 86us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.430202:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448372.430220:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448372.430227:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826298624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.430258:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826298624:12345-0@lo:400:kworker.0 Request processed in 32us (3595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.430263:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448372.430302:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297600 00000100:00100000:0.0:1788448372.430306:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297600 00000100:00100000:0.0:1788448372.430331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448372.430338:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826297600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.430370:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826297600:12345-0@lo:400:kworker.0 Request processed in 33us (3760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.430376:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448372.430396:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826297088 00000100:00100000:0.0:1788448372.430400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826297088 00000100:00100000:0.0:1788448372.430421:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788448372.430427:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826297088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448372.430455:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826297088:12345-0@lo:400:kworker.0 Request processed in 29us (3921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448372.430461:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:1.0:1788448372.431418:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448372.431425:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448372.431666:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788448372.432538:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826297088:0@lo:400:kworker.0 00000100:00100000:3.0:1788448372.432563:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826297600:0@lo:400:kworker.0 00010000:00080000:3.0:1788448372.432577:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cf100 x1875323826298112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448372.432588:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826298112:0@lo:400:kworker.0 00010000:00080000:3.0:1788448372.432598:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cd180 x1875323826298624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448372.432607:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826298624:0@lo:400:kworker.0 00010000:00010000:2.0:1788448372.734111:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448372.926407:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448372.926429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826298752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448372.926494:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448372.926772:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298752 00000100:00100000:2.0:1788448372.926781:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298752 00000100:00100000:2.0:1788448372.926840:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788448372.926850:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826298752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448372.926872:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448372.926995:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826298752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 146us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448372.927001:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448372.927418:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448372.927430:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826298880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448372.927462:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448372.927525:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826298880 00000100:00100000:3.0:1788448372.927529:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826298880 00000100:00100000:3.0:1788448372.927568:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788448372.927575:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826298880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448372.927587:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448372.927639:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826298880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448372.927645:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788448372.927726:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d52300 x1875323826298880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448372.927761:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826298880:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788448372.928173:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d50380 x1875323826298752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448372.928187:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826298752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448373.442730:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826299008:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448373.442788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448373.442854:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299008 00000100:00100000:2.0:1788448373.442861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299008 00000100:00100000:2.0:1788448373.442920:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448373.442951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826299008:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448373.442983:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788448373.443026:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826299008:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448373.443033:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448373.443077:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826299008:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448373.760939:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448374.783944:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448375.489494:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826299136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448375.489564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448375.489670:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299136 00000100:00100000:2.0:1788448375.489678:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299136 00000100:00100000:2.0:1788448375.489730:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448375.489739:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826299136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448375.489768:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448375.489807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826299136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448375.489813:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448375.489833:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826299264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448375.489856:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448375.489919:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299264 00000100:00100000:2.0:1788448375.489922:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299264 00000100:00100000:2.0:1788448375.489953:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448375.489958:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826299264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448375.489974:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448375.490001:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826299264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448375.490007:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788448375.490020:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448375.490045:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d51180 x1875323826299264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448375.490061:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826299264:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448375.490082:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826299136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448375.493199:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826299392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448375.493278:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448375.493361:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299392 00000100:00100000:3.0:1788448375.493368:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299392 00000100:00100000:3.0:1788448375.493418:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788448375.493426:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826299392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448375.493449:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448375.493489:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826299392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448375.493496:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788448375.493534:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1c11cca80 x1875323826299392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448375.493554:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826299392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448375.493590:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448375.809069:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448376.833905:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448377.534607:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826299648:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.534693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826299904:0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.534702:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.534734:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448377.534769:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826300160:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.534773:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826300416:0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.534803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.534824:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448377.534827:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826300672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.534856:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826300928:0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.534863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448377.534923:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788448377.534938:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826299520:0@lo:400:kworker.0 00000100:00100000:1.0:1788448377.534952:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788448377.535009:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299648 00000100:00100000:0.0:1788448377.535016:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299648 00000100:00100000:0.0:1788448377.535051:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299904 00000100:00100000:0.0:1788448377.535054:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299904 00000100:00100000:0.0:1788448377.535064:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300160 00000100:00100000:0.0:1788448377.535066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300160 00000100:00100000:0.0:1788448377.535087:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300672 00000100:00100000:0.0:1788448377.535090:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300672 00000100:00100000:0.0:1788448377.535105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788448377.535113:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826299648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535191:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448377.535245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788448377.535251:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448377.535277:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826300032:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535280:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300416 00000100:00100000:2.0:1788448377.535286:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300416 00000100:00100000:3.0:1788448377.535308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.535321:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300928 00000100:00100000:2.0:1788448377.535326:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300928 00000100:00100000:3.0:1788448377.535332:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826300544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535351:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448377.535357:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.535362:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826300416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.535376:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826301056:0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.535409:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.535416:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826300416:12345-0@lo:400:kworker.0 Request processed in 56us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535424:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448377.535439:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300544 00000100:00100000:2.0:1788448377.535443:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301056 00000100:00100000:3.0:1788448377.535446:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300544 00000100:00100000:2.0:1788448377.535449:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301056 00000100:00100000:2.0:1788448377.535475:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788448377.535484:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826300928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.535498:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788448377.535510:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826301056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535517:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826300928:12345-0@lo:400:kworker.0 Request processed in 34us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535524:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788448377.535540:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788448377.535547:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826300544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.535561:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826301056:12345-0@lo:400:kworker.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.535570:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448377.535591:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826300544:12345-0@lo:400:kworker.0 Request processed in 44us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535599:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1788448377.535613:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d50380 x1875323826300544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448377.535626:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788448377.535629:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826300544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535637:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826299904:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788448377.535658:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85ad80 x1875323826301056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448377.535671:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826301056:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535700:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826299904:12345-0@lo:400:kworker.0 Request processed in 65us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535708:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788448377.535723:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788448377.535730:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788448377.535735:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826300160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535742:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826300672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.535788:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826300160:12345-0@lo:400:kworker.0 Request processed in 56us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535790:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826300672:12345-0@lo:400:kworker.0 Request processed in 50us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535799:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788448377.535810:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788448377.535823:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300032 00000100:00100000:2.0:1788448377.535828:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300032 00000100:00080000:3.0:1788448377.535837:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448377.535842:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448377.535860:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788448377.535865:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826300160:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535871:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826300032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448377.535903:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826300672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535938:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826300032:12345-0@lo:400:kworker.0 Request processed in 69us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.535945:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788448377.535948:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826299904:0@lo:400:kworker.0 00010000:00080000:3.0:1788448377.535964:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d50a80 x1875323826300416/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448377.535973:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826300416:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.535991:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826300032:0@lo:400:kworker.0 00010000:00080000:3.0:1788448377.536002:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b480 x1875323826300928/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448377.536012:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826300928:0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.536023:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299520 00000100:00100000:2.0:1788448377.536028:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299520 00000100:00100000:2.0:1788448377.536053:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788448377.536059:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826299520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448377.536092:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826299520:12345-0@lo:400:kworker.0 Request processed in 33us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.536098:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788448377.536136:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826299520:0@lo:400:kworker.0 00000100:00100000:0.0:1788448377.541918:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826299648:12345-0@lo:400:kworker.0 Request processed in 6797us (7211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.541932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788448377.542005:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826299648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448377.544697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.544761:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826300288:0@lo:400:kworker.0 00000100:00100000:1.0:1788448377.544803:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.544828:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826300800:0@lo:400:kworker.0 00000100:00100000:1.0:1788448377.544849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.544935:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300288 00000100:00100000:1.0:1788448377.544942:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300288 00000100:00100000:1.0:1788448377.544986:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826300800 00000100:00100000:1.0:1788448377.544990:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826300800 00000100:00100000:1.0:1788448377.545010:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788448377.545019:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826300288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448377.545087:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826300288:12345-0@lo:400:kworker.0 Request processed in 69us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.545094:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788448377.545111:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788448377.545116:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826300800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448377.545143:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826300800:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.545148:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1788448377.545166:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788448377.545190:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d50e00 x1875323826300288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448377.545216:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826300288:0@lo:400:kworker.0 00010000:00080000:1.0:1788448377.545227:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf858a80 x1875323826300800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448377.545236:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826300800:0@lo:400:kworker.0 00000100:00100000:0.0:1788448377.547058:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826299776 00000100:00100000:0.0:1788448377.547069:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826299776 00000100:00100000:0.0:1788448377.547125:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448377.547135:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826299776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448377.547223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826299776:12345-0@lo:400:kworker.0 Request processed in 90us (2534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.547231:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788448377.548181:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826299776:0@lo:400:kworker.0 00000001:00100000:3.0:1788448377.551018:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000100:00100000:2.0:1788448377.701551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448377.701609:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448377.701668:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057280 00000100:00100000:1.0:1788448377.701678:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057280 00000100:00100000:1.0:1788448377.701736:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:1.0:1788448377.701747:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801057280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448377.701794:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057536 00000100:00100000:3.0:1788448377.701799:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057536 00000100:00100000:1.0:1788448377.701822:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801057280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.701832:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:3.0:1788448377.701862:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:3.0:1788448377.701872:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801057536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:1.0:1788448377.701905:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448377.701939:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801057536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.701945:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:2.0:1788448377.708087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448377.708142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448377.708281:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058048 00000100:00100000:3.0:1788448377.708292:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058048 00000100:00100000:3.0:1788448377.708376:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:3.0:1788448377.708403:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801058048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448377.708508:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801058048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.708517:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:1.0:1788448377.708779:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057792 00000100:00100000:1.0:1788448377.708785:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057792 00000100:00100000:1.0:1788448377.708829:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:1.0:1788448377.708838:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801057792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448377.708906:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801057792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.708913:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00080000:2.0:1788448377.709384:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448377.709389:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448377.711910:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448377.712043:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057408 00000100:00100000:1.0:1788448377.712051:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057408 00000100:00100000:1.0:1788448377.712125:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 146 00000100:00100000:1.0:1788448377.712136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801057408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448377.712212:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801057408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.712219:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 146 00000100:00080000:2.0:1788448377.712575:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448377.723866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448377.724131:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057664 00000100:00100000:1.0:1788448377.724141:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057664 00000100:00100000:1.0:1788448377.724220:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00100000:1.0:1788448377.724241:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801057664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448377.724325:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801057664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 95us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.724333:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00080000:2.0:1788448377.724544:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448377.724799:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448377.725132:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801057920 00000100:00100000:2.0:1788448377.725138:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801057920 00000100:00100000:2.0:1788448377.725189:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:2.0:1788448377.725197:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801057920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448377.725249:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801057920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.725256:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00080000:3.0:1788448377.725488:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448377.854213:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448378.048679:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826301184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448378.048751:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448378.048952:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301184 00000100:00100000:2.0:1788448378.048960:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301184 00000100:00100000:2.0:1788448378.049341:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788448378.049353:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826301184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448378.049382:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448378.049439:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826301184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448378.049446:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788448378.049511:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf859180 x1875323826301184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448378.049542:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826301184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448378.053477:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448378.053499:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826301312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448378.053582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448378.057684:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301312 00000100:00100000:0.0:1788448378.057699:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301312 00000100:00100000:0.0:1788448378.057746:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788448378.057756:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826301312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448378.057800:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448378.057864:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826301312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (4280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448378.057871:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1788448378.058151:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0e00 x1875323826301312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448378.058171:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826301312:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448378.561425:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448378.561455:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826301440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448378.561520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448378.563402:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301440 00000100:00100000:0.0:1788448378.563416:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301440 00000100:00100000:0.0:1788448378.563470:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448378.563479:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826301440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448378.563511:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448378.563586:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826301440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (2065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448378.563593:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448378.563673:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826301440:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788448378.566517:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:00100000:3.0:1788448378.567500:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:00100000:0.0:1788448378.568739:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:02000400:1.0:1788448378.740180:0:12187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788448378.884196:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448379.902601:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448380.607117:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826301568:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448380.607188:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448380.607707:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301568 00000100:00100000:2.0:1788448380.607716:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301568 00000100:00100000:2.0:1788448380.607765:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788448380.607776:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826301568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448380.607822:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448380.607868:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826301568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448380.607876:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788448380.608081:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826301824:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448380.608117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448380.608157:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301824 00000100:00100000:0.0:1788448380.608161:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301824 00000100:00100000:0.0:1788448380.608197:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788448380.608204:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826301824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448380.608221:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448380.608268:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb8e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826301824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448380.608285:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788448380.608450:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788448380.608478:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836faa00 x1875323826301824/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448380.608494:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826301824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448380.609283:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826301696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448380.609337:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448380.609402:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826301568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448380.610316:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301696 00000100:00100000:3.0:1788448380.610438:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301696 00000100:00100000:3.0:1788448380.610499:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788448380.610514:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826301696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448380.610535:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448380.610589:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826301696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.610595:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788448380.610694:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0e00 x1875323826301696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448380.610711:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826301696:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448380.610733:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448380.929155:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448381.950109:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448382.660366:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826301952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660484:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826302464:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660510:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660529:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826302976:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660552:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660569:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826303488:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660589:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660640:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788448382.660647:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826302336:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660675:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826302848:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660709:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660723:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826303360:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660743:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660773:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826302080:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.660820:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826302592:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.660841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.662666:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826303104:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.662712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.662747:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788448382.662756:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826302208:0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.662760:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302336 00000100:00100000:0.0:1788448382.662769:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302336 00000100:00100000:2.0:1788448382.662784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.662808:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826302720:0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.662810:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302080 00000100:00100000:0.0:1788448382.662815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302080 00000100:00100000:0.0:1788448382.662832:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302592 00000100:00100000:0.0:1788448382.662835:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302592 00000100:00100000:2.0:1788448382.662841:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448382.662858:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303104 00000100:00100000:2.0:1788448382.662861:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826303232:0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.662863:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303104 00000100:00100000:0.0:1788448382.662879:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302720 00000100:00100000:0.0:1788448382.662897:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302720 00000100:00100000:0.0:1788448382.662914:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788448382.662921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448382.662926:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826302336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.662953:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826301952 00000100:00100000:2.0:1788448382.662958:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826301952 00000100:00100000:0.0:1788448382.662985:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826302336:12345-0@lo:400:kworker.0 Request processed in 62us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.662992:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788448382.662996:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788448382.663010:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826301952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.663014:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303232 00000100:00100000:0.0:1788448382.663018:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303232 00000100:00100000:0.0:1788448382.663036:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788448382.663043:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826302080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.663054:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826301952:12345-0@lo:400:kworker.0 Request processed in 47us (2620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.663062:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788448382.663502:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826302080:12345-0@lo:400:kworker.0 Request processed in 458us (2700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.663509:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788448382.663536:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788448382.663544:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826302592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.663578:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826302592:12345-0@lo:400:kworker.0 Request processed in 35us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.663584:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788448382.663596:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788448382.663602:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826303104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.663639:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826303104:12345-0@lo:400:kworker.0 Request processed in 37us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.663645:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788448382.663656:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788448382.663662:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826302720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.663839:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826302720:12345-0@lo:400:kworker.0 Request processed in 176us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.663846:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788448382.663859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448382.663866:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826303232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448382.663910:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826303232:12345-0@lo:400:kworker.0 Request processed in 45us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.663916:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:0.0:1788448382.663932:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448382.663937:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448382.664018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302464 00000100:00100000:2.0:1788448382.664024:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302464 00000100:00100000:2.0:1788448382.664046:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302208 00000100:00100000:2.0:1788448382.664050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302208 00000100:00100000:2.0:1788448382.664063:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788448382.664069:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826302464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.664168:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826302464:12345-0@lo:400:kworker.0 Request processed in 99us (3656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.664174:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788448382.664187:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788448382.664192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826302208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.664227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826302208:12345-0@lo:400:kworker.0 Request processed in 35us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.664233:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788448382.664253:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302976 00000100:00100000:2.0:1788448382.664256:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302976 00000100:00100000:2.0:1788448382.664290:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303488 00000100:00100000:2.0:1788448382.664293:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303488 00000100:00100000:2.0:1788448382.664308:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826302848 00000100:00080000:0.0:1788448382.664309:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448382.664312:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826302848 00000100:00080000:0.0:1788448382.664314:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448382.664330:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448382.664338:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303360 00000100:00100000:2.0:1788448382.664342:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303360 00000100:00080000:0.0:1788448382.664366:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448382.664370:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448382.664377:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826302976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.664407:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826302976:12345-0@lo:400:kworker.0 Request processed in 30us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.664413:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448382.664425:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448382.664431:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826303488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.664461:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826303488:12345-0@lo:400:kworker.0 Request processed in 31us (3871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.664468:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448382.664481:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448382.664487:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826302848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.664514:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826302848:12345-0@lo:400:kworker.0 Request processed in 27us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.664520:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448382.664803:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448382.664816:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826303360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.664849:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826303360:12345-0@lo:400:kworker.0 Request processed in 35us (4105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.664856:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448382.665024:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826302336:0@lo:400:kworker.0 00010000:00080000:2.0:1788448382.665041:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf859180 x1875323826302848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.665052:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826302848:0@lo:400:kworker.0 00010000:00080000:2.0:1788448382.665062:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9500 x1875323826303360/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.665071:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826303360:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.665092:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826301952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.665104:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826302464:0@lo:400:kworker.0 00010000:00080000:2.0:1788448382.665113:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf858a80 x1875323826302976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.665121:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826302976:0@lo:400:kworker.0 00010000:00080000:2.0:1788448382.665130:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9180 x1875323826303488/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.665138:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826303488:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.665181:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826302208:0@lo:400:kworker.0 00010000:00080000:2.0:1788448382.665192:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b800 x1875323826302720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.665207:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826302720:0@lo:400:kworker.0 00010000:00080000:2.0:1788448382.665218:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85ad80 x1875323826303232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.665226:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826303232:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.665235:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826302080:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.665246:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826302592:0@lo:400:kworker.0 00000100:00100000:2.0:1788448382.665256:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826303104:0@lo:400:kworker.0 00000100:00100000:1.0:1788448382.826074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826129:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826173:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826189:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448382.826279:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058432 00000100:00100000:1.0:1788448382.826299:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058432 00000100:00100000:1.0:1788448382.826348:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058688 00000100:00100000:1.0:1788448382.826351:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058688 00000100:00100000:1.0:1788448382.826363:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058304 00000100:00100000:1.0:1788448382.826365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058304 00000100:00100000:1.0:1788448382.826375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058560 00000100:00100000:1.0:1788448382.826386:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058560 00000100:00100000:1.0:1788448382.826405:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:1.0:1788448382.826676:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801058432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448382.826743:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801058432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448382.826750:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:1.0:1788448382.826769:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:1.0:1788448382.826775:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448382.826796:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448382.826802:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:1.0:1788448382.826811:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:1.0:1788448382.826816:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801058304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448382.826836:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801058304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448382.826841:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:1.0:1788448382.826850:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 157 00000100:00100000:1.0:1788448382.826856:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448382.826876:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448382.826908:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 157 00000100:00080000:1.0:1788448382.826924:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448382.826928:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448382.827960:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058176 00000100:00100000:3.0:1788448382.827969:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058176 00000100:00100000:2.0:1788448382.828105:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058944 00000100:00100000:2.0:1788448382.828110:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058944 00000100:00100000:2.0:1788448382.828151:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801058816 00000100:00100000:2.0:1788448382.828154:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801058816 00000100:00100000:2.0:1788448382.828175:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:2.0:1788448382.828183:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448382.828245:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.828252:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:2.0:1788448382.828267:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:2.0:1788448382.828273:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448382.828692:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801058816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 418us (2435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.828700:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1788448382.828931:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 307 00000100:00100000:3.0:1788448382.828956:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801058176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448382.828986:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801058176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448382.828991:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 307 00000100:00080000:1.0:1788448382.830698:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448382.830718:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788448382.974026:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448383.166673:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448383.166738:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448383.166850:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303616 00000100:00100000:0.0:1788448383.166866:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303616 00000100:00100000:0.0:1788448383.166927:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448383.167041:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448383.167050:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826303744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448383.167076:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448383.167154:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826303616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448383.167193:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448383.167243:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826303616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 307us (505us total) trans 0 rc 0/0 00010000:00080000:1.0:1788448383.167301:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836faa00 x1875323826303616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448383.167319:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826303616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448383.167423:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303744 00000100:00100000:2.0:1788448383.167434:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303744 00000100:00100000:0.0:1788448383.179013:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448383.179311:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448383.179326:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826303744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448383.179353:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448383.179441:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826303744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (12363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448383.179448:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1788448383.179515:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9180 x1875323826303744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448383.179535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826303744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448383.679495:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826303872:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448383.679557:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448383.679642:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826303872 00000100:00100000:1.0:1788448383.679649:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826303872 00000100:00100000:1.0:1788448383.679690:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788448383.679698:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826303872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448383.679726:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448383.679768:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826303872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448383.679774:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788448383.679815:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826303872:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788448383.998999:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448385.022144:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448385.726141:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826304000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448385.726206:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448385.726418:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304000 00000100:00100000:3.0:1788448385.726426:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304000 00000100:00100000:3.0:1788448385.726473:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788448385.726482:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826304000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448385.726510:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448385.726549:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826304000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448385.726555:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788448385.726613:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448385.726643:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0e00 x1875323826304000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448385.726675:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826304000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448385.727116:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826304128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448385.727152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448385.729514:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448385.729531:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826304256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448385.729588:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448385.729655:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304256 00000100:00100000:1.0:1788448385.729662:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304256 00000100:00100000:1.0:1788448385.729715:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788448385.729724:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826304256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448385.729742:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448385.729783:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826304256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448385.729790:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1788448385.729809:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448385.729834:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083689f80 x1875323826304256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448385.729851:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826304256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448385.730146:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304128 00000100:00100000:2.0:1788448385.730152:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304128 00000100:00100000:2.0:1788448385.730185:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788448385.730192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826304128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448385.730215:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448385.732832:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826304128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2632us (5671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448385.732845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788448385.736729:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826304128:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788448386.047096:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448386.108167:0:12503:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448386.108503:0:12503:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448387.070536:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448387.779630:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826304384:0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.779695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.779718:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826304512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.779746:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826304896:0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.779951:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304384 00000100:00100000:2.0:1788448387.779959:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304384 00000100:00100000:2.0:1788448387.780012:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788448387.780022:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826304384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.781344:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448387.781382:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304896 00000100:00100000:0.0:1788448387.781386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826305408:0@lo:400:kworker.0 00000100:00100000:3.0:1788448387.781387:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304896 00000100:00100000:0.0:1788448387.781417:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448387.781424:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788448387.781431:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826304896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.781434:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826305920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.781453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448387.781473:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826304896:12345-0@lo:400:kworker.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448387.781480:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448387.781485:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826304896:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.781525:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.781556:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826305024:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.781581:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.781662:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826305536:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.781703:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.781861:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826304384:12345-0@lo:400:kworker.0 Request processed in 1839us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.781870:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788448387.781934:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305408 00000100:00100000:2.0:1788448387.781938:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305408 00000100:00100000:2.0:1788448387.781971:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305920 00000100:00100000:2.0:1788448387.781974:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305920 00000100:00100000:2.0:1788448387.782006:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448387.782014:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826305408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.782051:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826305408:12345-0@lo:400:kworker.0 Request processed in 39us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.782057:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448387.782068:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448387.782073:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826305920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.782094:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826305920:12345-0@lo:400:kworker.0 Request processed in 22us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.782100:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1788448387.782116:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448387.782120:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448387.782155:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ed880 x1875323826305408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448387.782166:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826305408:0@lo:400:kworker.0 00010000:00080000:2.0:1788448387.782183:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb576300 x1875323826305920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448387.782191:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826305920:0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.782198:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826304384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.790433:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826304640:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.790500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.790536:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826305152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.790570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448387.790639:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304512 00000100:00100000:3.0:1788448387.790714:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304512 00000100:00100000:3.0:1788448387.794125:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305024 00000100:00100000:3.0:1788448387.794289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305024 00000100:00100000:3.0:1788448387.794320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305536 00000100:00100000:3.0:1788448387.794334:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305536 00000100:00100000:3.0:1788448387.794353:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448387.794373:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826304512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448387.794463:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826304512:12345-0@lo:400:kworker.0 Request processed in 102us (12938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448387.794470:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448387.794485:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788448387.794491:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826305024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448387.794518:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826305024:12345-0@lo:400:kworker.0 Request processed in 28us (12937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448387.794524:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788448387.794534:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788448387.794540:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826305536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448387.794580:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826305536:12345-0@lo:400:kworker.0 Request processed in 41us (12877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448387.794600:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788448387.798425:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826304768:0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.798506:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304640 00000100:00100000:0.0:1788448387.798546:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304640 00000100:00100000:0.0:1788448387.798619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448387.798629:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826304640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448387.798693:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826304640:12345-0@lo:400:kworker.0 Request processed in 66us (8193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448387.798701:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1788448387.799960:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448387.800130:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.800406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826305280:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.800464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.800484:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826305792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.800506:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.804276:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305152 00000100:00100000:2.0:1788448387.804290:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305152 00000100:00100000:2.0:1788448387.804328:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305280 00000100:00100000:2.0:1788448387.804331:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305280 00000100:00100000:2.0:1788448387.804395:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305792 00000100:00100000:2.0:1788448387.804398:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305792 00000100:00100000:2.0:1788448387.804420:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448387.804430:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826305280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.804534:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826305280:12345-0@lo:400:kworker.0 Request processed in 105us (4068us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.804541:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448387.804557:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788448387.804564:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826305792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.804607:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826305792:12345-0@lo:400:kworker.0 Request processed in 43us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.804614:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788448387.804633:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448387.804637:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448387.805740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448387.805845:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826304768 00000100:00100000:2.0:1788448387.805852:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826304768 00000100:00100000:2.0:1788448387.805875:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788448387.805934:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826305152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.806065:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826305152:12345-0@lo:400:kworker.0 Request processed in 182us (15493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.806072:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788448387.806088:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788448387.806095:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826304768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448387.806127:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826304768:12345-0@lo:400:kworker.0 Request processed in 33us (6000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.806260:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448387.807101:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826304768:0@lo:400:kworker.0 00010000:00080000:1.0:1788448387.807119:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ef100 x1875323826305280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448387.807130:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826305280:0@lo:400:kworker.0 00010000:00080000:1.0:1788448387.807153:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ef480 x1875323826305792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448387.807162:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826305792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.807306:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826304512:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.807318:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826305024:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.807329:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826305536:0@lo:400:kworker.0 00010000:00080000:1.0:1788448387.807364:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ec700 x1875323826305152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448387.807391:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826305152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.807401:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826305664:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.807455:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448387.807503:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826304640:0@lo:400:kworker.0 00000100:00100000:3.0:1788448387.807603:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826305664 00000100:00100000:3.0:1788448387.807609:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826305664 00000100:00100000:3.0:1788448387.807668:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788448387.807676:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826305664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448387.807717:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826305664:12345-0@lo:400:kworker.0 Request processed in 43us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448387.807723:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:1.0:1788448387.807920:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788448387.807942:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836edc00 x1875323826305664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448387.807952:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826305664:0@lo:400:kworker.0 00000100:00100000:1.0:1788448387.943558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.943606:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.943647:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.943669:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.943690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.943715:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.943744:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059200 00000100:00100000:1.0:1788448387.943753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059200 00000100:00100000:1.0:1788448387.943799:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059456 00000100:00100000:1.0:1788448387.943803:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059456 00000100:00100000:1.0:1788448387.943817:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059328 00000100:00100000:1.0:1788448387.943820:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059328 00000100:00100000:1.0:1788448387.943831:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059584 00000100:00100000:1.0:1788448387.943834:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059584 00000100:00100000:1.0:1788448387.943850:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:1.0:1788448387.943858:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801059200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448387.943951:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801059200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 92us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448387.943972:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:1.0:1788448387.943990:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:1.0:1788448387.944008:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801059456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448387.944036:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801059456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448387.944042:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:1.0:1788448387.944054:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:1.0:1788448387.944061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801059328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448387.944085:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801059328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448387.944091:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:1.0:1788448387.944105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:1.0:1788448387.944111:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801059584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448387.944133:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801059584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448387.944139:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:1.0:1788448387.944161:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059840 00000100:00100000:1.0:1788448387.944164:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059840 00000100:00100000:0.0:1788448387.944395:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059072 00000100:00100000:0.0:1788448387.944400:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059072 00000100:00100000:0.0:1788448387.944437:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 309 00000100:00100000:0.0:1788448387.944445:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801059072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448387.944475:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801059072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448387.944481:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 309 00000100:00100000:3.0:1788448387.945708:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448387.950082:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059712 00000100:00100000:1.0:1788448387.950095:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059712 00000100:00100000:1.0:1788448387.950164:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:1.0:1788448387.950961:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801059840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448387.951121:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801059840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 172us (7403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448387.951146:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:1.0:1788448387.951184:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:1.0:1788448387.951193:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801059712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448387.951225:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801059712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (5525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448387.951231:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00080000:1.0:1788448387.951255:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448387.951260:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448387.951277:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448387.951280:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788448388.094334:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448388.242787:0:12601:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448388.243344:0:12601:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788448388.286656:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826306048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448388.286729:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448388.286986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826306176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448388.287017:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448388.287092:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306048 00000100:00100000:3.0:1788448388.287098:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306048 00000100:00100000:3.0:1788448388.287147:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306176 00000100:00100000:3.0:1788448388.287150:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306176 00000100:00100000:3.0:1788448388.287166:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448388.287174:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826306048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448388.287201:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448388.287249:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826306048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448388.287255:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448388.287271:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788448388.287294:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826306176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448388.287305:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448388.287333:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826306176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448388.287338:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788448388.287367:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d51c00 x1875323826306176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448388.287383:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826306176:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788448388.287405:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0e00 x1875323826306048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448388.287416:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826306048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448388.799078:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448388.799102:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826306304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448388.799182:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448388.799336:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306304 00000100:00100000:1.0:1788448388.799344:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306304 00000100:00100000:1.0:1788448388.799409:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788448388.799419:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826306304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448388.799453:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448388.799500:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826306304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448388.799507:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788448388.799545:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826306304:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788448389.123142:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448390.147649:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448390.735156:0:12698:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448390.735384:0:12698:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788448390.847491:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826306432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448390.847566:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448390.847642:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306432 00000100:00100000:3.0:1788448390.847650:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306432 00000100:00100000:3.0:1788448390.847703:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788448390.847713:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826306432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448390.847739:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448390.847780:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826306432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.847787:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1788448390.847826:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d51c00 x1875323826306432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448390.847842:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826306432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448390.847971:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448390.848177:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826306560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448390.848204:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448390.848251:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306560 00000100:00100000:3.0:1788448390.848255:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306560 00000100:00100000:3.0:1788448390.848284:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788448390.848290:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826306560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448390.848301:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448390.848331:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826306560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.848338:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788448390.848351:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448390.848369:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836fad80 x1875323826306560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448390.848381:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826306560:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448390.848626:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826306688:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448390.848656:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448390.848720:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306688 00000100:00100000:1.0:1788448390.848725:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306688 00000100:00100000:1.0:1788448390.848759:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788448390.848767:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826306688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448390.848797:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788448390.848846:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826306688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448390.848852:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788448390.849132:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826306688:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788448391.166301:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448392.190134:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448392.894606:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448392.894635:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826307200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.894707:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.894732:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.894743:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.894795:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826307840:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.894848:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.894875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826308352:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.894924:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.894959:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448392.894975:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826307712:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.895000:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.895025:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826308224:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.895048:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.895084:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307840 00000100:00100000:2.0:1788448392.895093:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307840 00000100:00100000:2.0:1788448392.895147:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308352 00000100:00100000:2.0:1788448392.895151:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308352 00000100:00100000:2.0:1788448392.895166:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307712 00000100:00100000:2.0:1788448392.895169:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307712 00000100:00100000:2.0:1788448392.895927:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308224 00000100:00100000:2.0:1788448392.895936:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308224 00000100:00100000:2.0:1788448392.895965:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788448392.895987:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826307840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.896058:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826307840:12345-0@lo:400:kworker.0 Request processed in 72us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.896066:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788448392.896083:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788448392.896089:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826308352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.896118:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826308352:12345-0@lo:400:kworker.0 Request processed in 29us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.896124:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788448392.896135:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448392.896154:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826307712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.896416:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826307712:12345-0@lo:400:kworker.0 Request processed in 31us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.896424:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448392.896438:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788448392.896445:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826308224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.896568:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826308224:12345-0@lo:400:kworker.0 Request processed in 113us (1508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.896575:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:2.0:1788448392.896631:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424700 x1875323826307712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448392.896647:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826307712:0@lo:400:kworker.0 00010000:00080000:2.0:1788448392.896659:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb425f80 x1875323826308224/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448392.896667:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826308224:0@lo:400:kworker.0 00010000:00080000:2.0:1788448392.896679:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb427b80 x1875323826307840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448392.896687:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826307840:0@lo:400:kworker.0 00010000:00080000:2.0:1788448392.896697:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb425c00 x1875323826308352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448392.896705:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826308352:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.900843:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826306816:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.900971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.901119:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307200 00000100:00100000:0.0:1788448392.901152:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307200 00000100:00100000:0.0:1788448392.901218:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788448392.901230:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826307200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.901310:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826307200:12345-0@lo:400:kworker.0 Request processed in 82us (6577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448392.901318:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788448392.901352:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826307072:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.901386:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.901409:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826307584:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.901433:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.901455:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826308096:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.901477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.901499:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788448392.901507:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826306944:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.901530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.901546:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.902332:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306816 00000100:00100000:2.0:1788448392.902343:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306816 00000100:00100000:2.0:1788448392.902409:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788448392.902418:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826306816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.902481:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826306816:12345-0@lo:400:kworker.0 Request processed in 64us (1510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.902489:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:2.0:1788448392.903874:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448392.903900:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448392.904034:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.904072:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826307968:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.904097:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.904140:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307328 00000100:00100000:0.0:1788448392.904148:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307328 00000100:00100000:0.0:1788448392.904189:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307072 00000100:00100000:0.0:1788448392.904193:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307072 00000100:00100000:0.0:1788448392.904210:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448392.904220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826307328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.905492:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307584 00000100:00100000:3.0:1788448392.905503:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307584 00000100:00100000:3.0:1788448392.905569:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308096 00000100:00100000:3.0:1788448392.905573:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308096 00000100:00100000:3.0:1788448392.905589:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826306944 00000100:00100000:3.0:1788448392.905592:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826306944 00000100:00100000:3.0:1788448392.905603:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307456 00000100:00100000:3.0:1788448392.905606:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307456 00000100:00100000:3.0:1788448392.905616:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826307968 00000100:00100000:3.0:1788448392.905618:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826307968 00000100:00100000:3.0:1788448392.905635:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788448392.905643:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826307584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.905732:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826307584:12345-0@lo:400:kworker.0 Request processed in 90us (4297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.905739:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788448392.905756:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788448392.905762:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826308096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.905791:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826308096:12345-0@lo:400:kworker.0 Request processed in 30us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.905796:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788448392.905806:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788448392.905811:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826306944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.905840:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826306944:12345-0@lo:400:kworker.0 Request processed in 28us (4309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.905863:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788448392.905876:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788448392.905901:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826307456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.905935:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826307456:12345-0@lo:400:kworker.0 Request processed in 53us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.905941:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788448392.905952:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788448392.905958:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826307968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.906606:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826307968:12345-0@lo:400:kworker.0 Request processed in 643us (2504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.906615:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788448392.906688:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826306944:0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.906704:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826307456:0@lo:400:kworker.0 00000100:00100000:3.0:1788448392.906717:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826307968:0@lo:400:kworker.0 00010000:00080000:3.0:1788448392.906735:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b5f80 x1875323826307584/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448392.906747:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826307584:0@lo:400:kworker.0 00010000:00080000:3.0:1788448392.906760:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424380 x1875323826308096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448392.906768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826308096:0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.907090:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826307200:0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.907104:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826306816:0@lo:400:kworker.0 00000100:00080000:2.0:1788448392.907783:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448392.907792:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448392.915602:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826307328:12345-0@lo:400:kworker.0 Request processed in 11367us (20841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.915622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788448392.915677:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788448392.915695:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826307072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.915770:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826307072:12345-0@lo:400:kworker.0 Request processed in 84us (14383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.915776:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448392.916055:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826307328:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.916799:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826307072:0@lo:400:kworker.0 00000100:00100000:1.0:1788448393.072146:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448393.072213:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448393.072224:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060096 00000100:00100000:1.0:1788448393.072248:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448393.072255:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060096 00000100:00100000:1.0:1788448393.072282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448393.072301:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448393.072324:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448393.072332:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060224 00000100:00100000:3.0:1788448393.072335:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060224 00000100:00100000:1.0:1788448393.072346:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060480 00000100:00100000:1.0:1788448393.072349:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060480 00000100:00100000:3.0:1788448393.072356:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:3.0:1788448393.072368:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801060096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448393.072371:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:1.0:1788448393.072377:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801060224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448393.072462:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801060224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448393.072471:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:1.0:1788448393.072490:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 176 00000100:00100000:1.0:1788448393.072498:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801060480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448393.072605:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801059968 00000100:00100000:2.0:1788448393.072610:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801059968 00000100:00100000:2.0:1788448393.072644:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 311 00000100:00100000:2.0:1788448393.072651:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801059968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448393.072673:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801060096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 307us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448393.072676:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801059968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448393.072681:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:2.0:1788448393.072682:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 311 00000100:00100000:2.0:1788448393.072712:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060608 00000100:00100000:2.0:1788448393.072716:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060608 00000100:00100000:2.0:1788448393.072741:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060736 00000100:00100000:2.0:1788448393.072744:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060736 00000100:00100000:2.0:1788448393.072765:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788448393.072772:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2397:x1875323801060608:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1788448393.072794:0:8539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803804 00000100:00080000:2.0:1788448393.072804:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9fc083575000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788448393.072834:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788448393.072859:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1788448393.072871:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1788448393.072878:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2397:x1875323801060736:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788448393.072909:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80380b 00000100:00080000:3.0:1788448393.072916:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448393.072950:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788448393.073047:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+2:2397:x1875323801060608:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 275us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448393.073066:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1788448393.074081:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+2:2397:x1875323801060736:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 1193us (1769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448393.074094:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00080000:3.0:1788448393.074126:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448393.074131:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448393.074135:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448393.074138:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448393.074149:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448393.081483:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801060480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8966us (9138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448393.081501:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 176 00000100:00100000:2.0:1788448393.101162:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448393.101369:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060352 00000100:00100000:3.0:1788448393.101382:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060352 00000100:00100000:3.0:1788448393.101571:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:3.0:1788448393.101585:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801060352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448393.101686:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801060352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 104us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448393.101702:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00080000:2.0:1788448393.101830:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448393.223465:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788448393.293524:0:12795:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448393.293813:0:12795:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788448393.408802:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448393.408831:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826308480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448393.408934:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448393.409019:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308480 00000100:00100000:0.0:1788448393.409027:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308480 00000100:00100000:0.0:1788448393.409080:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788448393.409089:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826308480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448393.409124:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448393.409182:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826308480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448393.409190:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788448393.409237:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08368ad80 x1875323826308480/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448393.409430:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826308480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448393.417099:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826308608:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448393.417199:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448393.417573:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308608 00000100:00100000:2.0:1788448393.417585:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308608 00000100:00100000:2.0:1788448393.417660:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788448393.417673:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826308608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448393.417703:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448393.417761:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826308608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 91us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448393.417768:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1788448393.417944:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836edc00 x1875323826308608/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448393.417969:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826308608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448393.918080:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448393.918112:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826308736:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448393.918202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448393.918396:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308736 00000100:00100000:2.0:1788448393.918407:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308736 00000100:00100000:2.0:1788448393.918472:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788448393.918483:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826308736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448393.918531:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788448393.918592:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826308736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448393.918600:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448393.918831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826308736:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788448394.242343:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448395.264338:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788448395.832676:0:12893:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448395.833412:0:12893:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788448395.966244:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826308864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448395.966313:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448395.966386:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448395.966394:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826308992:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448395.966423:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448395.966461:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308992 00000100:00100000:1.0:1788448395.966468:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308992 00000100:00100000:1.0:1788448395.966518:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788448395.966529:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826308992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448395.966569:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448395.966613:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826308992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.966633:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1788448395.966673:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb427b80 x1875323826308992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448395.966691:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826308992:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448395.966916:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826308864 00000100:00100000:2.0:1788448395.966920:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826308864 00000100:00100000:2.0:1788448395.966952:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788448395.966959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826308864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448395.966984:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448395.967056:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826308864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448395.967062:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788448395.967079:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448395.967106:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826308864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448395.967481:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448395.967493:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826309120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448395.967526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448395.967602:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309120 00000100:00100000:2.0:1788448395.967607:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309120 00000100:00100000:2.0:1788448395.967644:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788448395.967651:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826309120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448395.967665:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448395.967699:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826309120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448395.967705:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788448395.967732:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ec700 x1875323826309120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448395.967745:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826309120:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448395.968105:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448396.289419:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448397.313701:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448398.014351:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826309376:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.015585:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.015672:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826309888:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.015719:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.015748:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826310400:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.015768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.015802:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788448398.015810:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826309248:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.015843:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.015875:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826309760:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.015917:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.015936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826310272:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.015979:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016000:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826310784:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016022:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016058:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826309504:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016097:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826310016:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016116:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016133:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826310528:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016153:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016168:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788448398.016174:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826309632:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016194:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016204:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826310144:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016222:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016241:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826310656:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016259:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.016296:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309376 00000100:00100000:2.0:1788448398.016306:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309376 00000100:00100000:2.0:1788448398.016351:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309888 00000100:00100000:2.0:1788448398.016354:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309888 00000100:00100000:2.0:1788448398.016379:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310400 00000100:00100000:2.0:1788448398.016382:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310400 00000100:00100000:2.0:1788448398.016394:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310016 00000100:00100000:2.0:1788448398.016402:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310016 00000100:00100000:2.0:1788448398.016419:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310528 00000100:00100000:2.0:1788448398.016422:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310528 00000100:00100000:2.0:1788448398.016432:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309632 00000100:00100000:2.0:1788448398.016434:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309632 00000100:00100000:2.0:1788448398.016449:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788448398.016475:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826309376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016548:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826309376:12345-0@lo:400:kworker.0 Request processed in 73us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016556:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788448398.016575:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788448398.016582:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826309888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016608:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826309888:12345-0@lo:400:kworker.0 Request processed in 28us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016614:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788448398.016625:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788448398.016630:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826310400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016652:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826310400:12345-0@lo:400:kworker.0 Request processed in 23us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016658:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788448398.016668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788448398.016674:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826310016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016701:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826310016:12345-0@lo:400:kworker.0 Request processed in 28us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016707:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788448398.016717:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788448398.016722:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826310528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016756:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826310528:12345-0@lo:400:kworker.0 Request processed in 33us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788448398.016773:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788448398.016777:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826309632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016799:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826309632:12345-0@lo:400:kworker.0 Request processed in 22us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016805:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788448398.016831:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309248 00000100:00100000:2.0:1788448398.016834:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309248 00000100:00100000:2.0:1788448398.016861:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788448398.016868:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826309248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.016920:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826309248:12345-0@lo:400:kworker.0 Request processed in 53us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.016926:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788448398.016956:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309760 00000100:00100000:2.0:1788448398.016960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309760 00000100:00100000:2.0:1788448398.016976:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826309504 00000100:00100000:2.0:1788448398.016978:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826309504 00000100:00100000:2.0:1788448398.016991:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448398.016997:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826309760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017027:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826309760:12345-0@lo:400:kworker.0 Request processed in 30us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.017032:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448398.017043:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788448398.017048:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826309504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017082:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826309504:12345-0@lo:400:kworker.0 Request processed in 34us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.017088:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788448398.017107:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310272 00000100:00100000:2.0:1788448398.017110:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310272 00000100:00100000:2.0:1788448398.017130:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310784 00000100:00100000:2.0:1788448398.017132:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310784 00000100:00100000:2.0:1788448398.017143:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310144 00000100:00100000:2.0:1788448398.017146:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310144 00000100:00100000:2.0:1788448398.017155:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310656 00000100:00100000:2.0:1788448398.017158:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310656 00000100:00100000:2.0:1788448398.017169:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788448398.017174:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826310272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017204:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826310272:12345-0@lo:400:kworker.0 Request processed in 30us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.017211:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788448398.017222:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788448398.017227:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826310784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017251:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826310784:12345-0@lo:400:kworker.0 Request processed in 24us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.017256:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788448398.017266:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448398.017270:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826310144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017294:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826310144:12345-0@lo:400:kworker.0 Request processed in 24us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.017300:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448398.017311:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448398.017323:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826310656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017351:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826310656:12345-0@lo:400:kworker.0 Request processed in 29us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.017357:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788448398.017396:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448398.017400:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448398.017403:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448398.017405:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448398.017446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826309632:0@lo:400:kworker.0 00010000:00080000:2.0:1788448398.017462:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf858e00 x1875323826310144/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.017473:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826310144:0@lo:400:kworker.0 00010000:00080000:2.0:1788448398.017484:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf858000 x1875323826310656/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.017491:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826310656:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826309504:0@lo:400:kworker.0 00010000:00080000:2.0:1788448398.017542:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b480 x1875323826310016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.017550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826310016:0@lo:400:kworker.0 00010000:00080000:2.0:1788448398.017559:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b800 x1875323826310528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.017566:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826310528:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017607:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826309248:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017627:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826309760:0@lo:400:kworker.0 00010000:00080000:2.0:1788448398.017637:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf859c00 x1875323826310272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.017646:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826310272:0@lo:400:kworker.0 00010000:00080000:2.0:1788448398.017655:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf858a80 x1875323826310784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.017662:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826310784:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017673:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826309376:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017684:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826309888:0@lo:400:kworker.0 00000100:00100000:2.0:1788448398.017695:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826310400:0@lo:400:kworker.0 00000100:00100000:0.0:1788448398.184980:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448398.185022:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448398.185160:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060992 00000100:00100000:2.0:1788448398.185172:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060992 00000100:00100000:2.0:1788448398.185241:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061248 00000100:00100000:2.0:1788448398.185245:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061248 00000100:00100000:2.0:1788448398.185272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00100000:2.0:1788448398.185282:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801060992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448398.185417:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:1.0:1788448398.185429:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801061248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448398.193992:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801060992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8693us (9009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.194012:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00080000:2.0:1788448398.195998:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448398.198515:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448398.198580:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448398.198650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061120 00000100:00100000:0.0:1788448398.198681:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061120 00000100:00100000:0.0:1788448398.198757:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:0.0:1788448398.198768:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801061120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448398.198859:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801061120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448398.198898:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:0.0:1788448398.198953:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448398.199009:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061376 00000100:00100000:0.0:1788448398.199013:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061376 00000100:00100000:0.0:1788448398.199713:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:0.0:1788448398.199728:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801061376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448398.199781:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801061376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 58us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448398.199788:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00080000:0.0:1788448398.199817:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448398.200786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801060864 00000100:00100000:2.0:1788448398.200797:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801060864 00000100:00100000:2.0:1788448398.200845:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 313 00000100:00100000:2.0:1788448398.200878:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801060864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448398.200952:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801060864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448398.200960:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 313 00000100:00100000:1.0:1788448398.209393:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801061248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23951us (24353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448398.209413:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 185 00010000:00010000:3.0:1788448398.337103:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448398.527806:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448398.527837:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826310912:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448398.529033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448398.529285:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826311040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448398.529320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00100000:0.0:1788448398.536685:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000020:00000080:0.0:1788448398.536697:0:9511:0:(genops.c:885:class_export_put()) final put ffff9fc0835a8800/66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000020:00000080:1.0:1788448398.540164:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835a8800/66d43c2c-d252-43d9-8f04-1c7a728a06f0 for lustre-OST0001 00000100:00100000:3.0:1788448398.540325:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826310912 00000100:00100000:3.0:1788448398.540342:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826310912 00000100:00100000:3.0:1788448398.540419:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311040 00000100:00100000:3.0:1788448398.540423:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311040 00000100:00100000:3.0:1788448398.540448:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788448398.540459:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826310912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448398.540506:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448398.540607:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826310912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 149us (11579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448398.540614:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788448398.540634:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788448398.540640:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826311040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448398.540770:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448398.540803:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826311040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 163us (11481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448398.540809:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:3.0:1788448398.540878:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373c000 x1875323826310912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448398.540932:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826310912:0@lo:13:osp-pre-1-1.0 00000020:00000080:1.0:1788448398.541297:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835ab000 for lustre-OST0001 00010000:00080000:2.0:1788448398.541562:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d51180 x1875323826311040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448398.541580:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826311040:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788448398.544494:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000020:00000080:2.0:1788448398.544505:0:8427:0:(genops.c:885:class_export_put()) final put ffff9fc083570000/66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000020:00000080:2.0:1788448398.544546:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083570000/66d43c2c-d252-43d9-8f04-1c7a728a06f0 for lustre-OST0000 00000020:00000080:2.0:1788448398.544619:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083575000 for lustre-OST0000 00000100:00100000:2.0:1788448399.038509:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826311168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448399.038610:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448399.038745:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311168 00000100:00100000:2.0:1788448399.038754:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311168 00000100:00100000:2.0:1788448399.038806:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788448399.038816:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826311168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448399.038857:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788448399.038926:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826311168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448399.038946:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788448399.039000:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826311168:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788448399.358171:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448400.390976:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448400.494581:0:13037:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788448401.086716:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448401.086818:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448401.086928:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448401.086935:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826311424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448401.086973:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448401.087116:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311296 00000100:00100000:3.0:1788448401.087128:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311296 00000100:00100000:3.0:1788448401.087202:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788448401.087322:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826311296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448401.087359:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448401.087409:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826311296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 198us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448401.087418:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788448401.087591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311424 00000100:00100000:2.0:1788448401.087596:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311424 00000100:00100000:2.0:1788448401.087632:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788448401.087643:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826311424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448401.087669:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448401.087703:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826311424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448401.087709:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788448401.087907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448401.087948:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826311424:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1788448401.087961:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373ca80 x1875323826311296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448401.088037:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826311296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448401.088360:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826311552:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448401.088401:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448401.088572:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311552 00000100:00100000:2.0:1788448401.088577:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311552 00000100:00100000:2.0:1788448401.088618:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788448401.088625:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826311552:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448401.088638:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448401.088677:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826311552:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448401.088684:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788448401.088729:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448401.088840:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373f480 x1875323826311552/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448401.088855:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826311552:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788448401.407231:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448402.439978:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448403.134402:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826311680:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134466:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134518:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826312192:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134555:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826312704:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134575:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134589:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826313216:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134607:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134627:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788448403.134633:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826312064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134657:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134674:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826312576:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134695:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134710:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826313088:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134759:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826311808:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134780:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134797:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826312320:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134815:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134847:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826312832:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134868:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134915:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788448403.134922:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826311936:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134961:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826312448:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.134979:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.134989:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826312960:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135003:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.135029:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312064 00000100:00100000:0.0:1788448403.135036:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312064 00000100:00100000:0.0:1788448403.135070:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311808 00000100:00100000:0.0:1788448403.135072:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311808 00000100:00100000:0.0:1788448403.135097:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312320 00000100:00100000:0.0:1788448403.135099:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312320 00000100:00100000:0.0:1788448403.135120:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312832 00000100:00100000:0.0:1788448403.135122:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312832 00000100:00100000:0.0:1788448403.135133:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312448 00000100:00100000:0.0:1788448403.135135:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312448 00000100:00100000:0.0:1788448403.135144:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312960 00000100:00100000:0.0:1788448403.135146:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312960 00000100:00100000:0.0:1788448403.135160:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788448403.135168:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826312064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135216:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826312064:12345-0@lo:400:kworker.0 Request processed in 48us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788448403.135241:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788448403.135247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826311808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135289:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826311808:12345-0@lo:400:kworker.0 Request processed in 42us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135295:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788448403.135307:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788448403.135313:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826312320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135339:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826312320:12345-0@lo:400:kworker.0 Request processed in 26us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788448403.135355:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788448403.135360:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826312832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135384:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826312832:12345-0@lo:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135390:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788448403.135401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788448403.135406:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826312448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135558:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826312448:12345-0@lo:400:kworker.0 Request processed in 151us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788448403.135577:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788448403.135584:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826312960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135610:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826312960:12345-0@lo:400:kworker.0 Request processed in 27us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135615:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788448403.135642:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312192 00000100:00100000:0.0:1788448403.135646:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312192 00000100:00100000:0.0:1788448403.135671:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311936 00000100:00100000:0.0:1788448403.135674:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311936 00000100:00100000:0.0:1788448403.135686:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788448403.135691:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826312192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135725:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826312192:12345-0@lo:400:kworker.0 Request processed in 34us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135731:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788448403.135744:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788448403.135750:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826311936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135776:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826311936:12345-0@lo:400:kworker.0 Request processed in 27us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.135782:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1788448403.135797:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448403.135801:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448403.135826:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826312064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135839:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826312192:0@lo:400:kworker.0 00000100:00100000:0.0:1788448403.135869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826311936:0@lo:400:kworker.0 00010000:00080000:0.0:1788448403.135899:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f8000 x1875323826312448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448403.135910:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826312448:0@lo:400:kworker.0 00010000:00080000:0.0:1788448403.135921:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb794e00 x1875323826312960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448403.135929:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826312960:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.135990:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826311680 00000100:00100000:2.0:1788448403.135995:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826311680 00000100:00100000:2.0:1788448403.136020:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788448403.136026:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826311680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.136058:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826311680:12345-0@lo:400:kworker.0 Request processed in 33us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.136064:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788448403.136111:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312704 00000100:00100000:2.0:1788448403.136114:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312704 00000100:00100000:2.0:1788448403.136136:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313216 00000100:00100000:2.0:1788448403.136139:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313216 00000100:00100000:2.0:1788448403.136150:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826312576 00000100:00100000:2.0:1788448403.136153:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826312576 00000100:00100000:2.0:1788448403.136164:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313088 00000100:00100000:2.0:1788448403.136166:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313088 00000100:00100000:2.0:1788448403.136179:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788448403.136185:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826312704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.136210:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826312704:12345-0@lo:400:kworker.0 Request processed in 26us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.136216:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788448403.136225:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448403.136230:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826313216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.136248:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826313216:12345-0@lo:400:kworker.0 Request processed in 18us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.136253:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448403.136260:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788448403.136265:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826312576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.136282:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826312576:12345-0@lo:400:kworker.0 Request processed in 17us (1587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.136287:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788448403.136295:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788448403.136299:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826313088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.136316:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826313088:12345-0@lo:400:kworker.0 Request processed in 16us (1585us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.136329:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1788448403.136363:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9f80 x1875323826312576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448403.136373:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826312576:0@lo:400:kworker.0 00010000:00080000:2.0:1788448403.136394:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797100 x1875323826313088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448403.136403:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826313088:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.136412:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826311680:0@lo:400:kworker.0 00010000:00080000:2.0:1788448403.136420:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823faa00 x1875323826312704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448403.136428:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826312704:0@lo:400:kworker.0 00010000:00080000:2.0:1788448403.136436:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796680 x1875323826313216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448403.136444:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826313216:0@lo:400:kworker.0 00000100:00080000:2.0:1788448403.136466:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448403.136469:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448403.148552:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826311808:0@lo:400:kworker.0 00000100:00100000:1.0:1788448403.148571:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826312320:0@lo:400:kworker.0 00000100:00100000:1.0:1788448403.148582:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826312832:0@lo:400:kworker.0 00000100:00100000:1.0:1788448403.309189:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448403.309274:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448403.309299:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448403.309318:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448403.309342:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448403.315272:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061632 00000100:00100000:1.0:1788448403.315287:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061632 00000100:00100000:1.0:1788448403.315446:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061760 00000100:00100000:1.0:1788448403.315450:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061760 00000100:00100000:1.0:1788448403.315467:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062016 00000100:00100000:1.0:1788448403.315470:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062016 00000100:00100000:1.0:1788448403.315482:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061888 00000100:00100000:1.0:1788448403.315485:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061888 00000100:00100000:1.0:1788448403.315512:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:1.0:1788448403.315522:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801061632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448403.315606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801061632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (6331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448403.315613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:1.0:1788448403.315630:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:1.0:1788448403.315636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801061760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448403.315656:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801061760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (6357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448403.315662:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:1.0:1788448403.315670:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:1.0:1788448403.315675:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801062016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448403.315691:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801062016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 17us (6373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448403.315697:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:1.0:1788448403.315704:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:1.0:1788448403.315710:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801061888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448403.315725:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801061888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 15us (6382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448403.315737:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00080000:3.0:1788448403.315902:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448403.315907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448403.319662:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801061504 00000100:00100000:0.0:1788448403.319689:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801061504 00000100:00100000:0.0:1788448403.321512:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 315 00000100:00100000:0.0:1788448403.321533:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801061504:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448403.321625:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801061504:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 100us (12443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.321633:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 315 00010000:00010000:0.0:1788448403.462534:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448403.648988:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826313344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448403.649054:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.649139:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313344 00000100:00100000:2.0:1788448403.649147:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313344 00000100:00100000:2.0:1788448403.649202:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448403.649212:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826313344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448403.649240:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448403.649295:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826313344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.649303:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1788448403.649342:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373ed80 x1875323826313344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448403.649360:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826313344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448403.651732:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826313472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448403.651793:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448403.653317:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313472 00000100:00100000:0.0:1788448403.653328:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313472 00000100:00100000:0.0:1788448403.653389:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788448403.653400:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826313472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448403.653425:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448403.653488:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826313472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448403.653494:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788448403.653548:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d50700 x1875323826313472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448403.653567:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826313472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448404.159954:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448404.159992:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826313600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448404.160068:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448404.160136:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313600 00000100:00100000:0.0:1788448404.160144:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313600 00000100:00100000:0.0:1788448404.160201:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788448404.160214:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826313600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448404.160248:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448404.160326:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826313600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.160335:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788448404.160420:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826313600:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788448404.478255:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448404.969274:0:13185:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe68f23350 20000000:00000080:0.0:1788448404.969296:0:13185:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc083670400 uarg=0000000000000000 20000000:01000000:0.0:1788448404.969344:0:13185:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448404.969350:0:13185:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448404.969355:0:13185:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788448404.970742:0:13186:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788448404.971047:0:13185:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788448404.980265:0:13185:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788448404.980301:0:13185:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980321:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980331:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980337:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980343:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980350:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980357:0:13185:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980364:0:13185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980432:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980469:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 12 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448404.980484:0:13185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826313728:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448404.980632:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980642:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 23 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448404.980653:0:13185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826313856:0@lo:104: 00000100:00100000:1.0:1788448404.980695:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448404.980741:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.980751:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 23 pid: 6509 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448404.980760:0:13185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826313984:0@lo:104: 00000100:00100000:1.0:1788448404.980783:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448404.980811:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313856 00010000:00010000:1.0:1788448404.980819:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448404.980820:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313856 00010000:00010000:1.0:1788448404.980831:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 23 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448404.980841:0:13185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826314112:0@lo:104: 00000100:00100000:1.0:1788448404.980864:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448404.980906:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826313984 00000100:00100000:0.0:1788448404.980911:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826313984 00000100:00100000:0.0:1788448404.980928:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826314112 00000100:00100000:0.0:1788448404.980931:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826314112 00000100:00100000:0.0:1788448404.980945:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788448404.980954:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:13185:x1875323826313856:12345-0@lo:104: 00010000:00010000:0.0:1788448404.980967:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.981016:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448404.981022:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:13185:x1875323826313856:12345-0@lo:104: Request processed in 70us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.981030:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788448404.981049:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788448404.981056:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:13185:x1875323826313984:12345-0@lo:104: 00010000:00010000:0.0:1788448404.981065:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.981096:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.981106:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 23 pid: 6511 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448404.981115:0:13185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826314240:0@lo:104: 00010000:00010000:0.0:1788448404.981116:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448404.981125:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:13185:x1875323826313984:12345-0@lo:104: Request processed in 69us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.981132:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448404.981146:0:13185:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448404.981152:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448404.981161:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:13185:x1875323826314112:12345-0@lo:104: 00010000:00010000:0.0:1788448404.981169:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.981171:0:13185:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448404.981191:0:13185:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448404.981201:0:13185:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826314368:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448404.981217:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788448404.981224:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:13185:x1875323826314112:12345-0@lo:104: Request processed in 65us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.981230:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448404.981235:0:13185:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448404.981244:0:6500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826314240 00000100:00100000:0.0:1788448404.981249:0:6500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826314240 00000100:00100000:1.0:1788448404.981260:0:13185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826313856:0@lo:104: 00000100:00100000:0.0:1788448404.981268:0:6500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448404.981272:0:13185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826313984:0@lo:104: 00000100:00100000:0.0:1788448404.981278:0:6500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:13185:x1875323826314240:12345-0@lo:104: 00000100:00100000:1.0:1788448404.981283:0:13185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826314112:0@lo:104: 00010000:00010000:0.0:1788448404.981288:0:6500:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.982723:0:6500:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788448404.982737:0:6500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:13185:x1875323826314240:12345-0@lo:104: Request processed in 1459us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.982748:0:6500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788448404.982779:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788448404.982786:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.982812:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448404.982817:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.982827:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448404.982835:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448404.982841:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448404.982955:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448404.982962:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.982970:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448404.982973:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.982980:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448404.982994:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448404.983000:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448404.983068:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.983075:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448404.983097:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.983104:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc18152f400/0xf45a9e4e6b8037d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037da expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.983117:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448404.983121:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.983127:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448404.983130:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.983148:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448404.983156:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448404.983161:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788448404.983243:0:13185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826314240:0@lo:104: 00010000:00010000:3.0:1788448404.984113:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984125:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448404.984157:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984165:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b8037c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984178:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448404.984182:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984188:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681a00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448404.984191:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984199:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448404.984204:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448404.984210:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448404.984237:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984243:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448404.984249:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984254:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181681a00/0xf45a9e4e6b8037a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037b0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984264:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448404.984265:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448404.984267:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448404.984338:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826314624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448404.984405:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448404.984459:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448404.984466:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826314752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448404.984489:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448404.984764:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826314624 00000100:00100000:3.0:1788448404.984771:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826314624 00010000:00010000:3.0:1788448404.984802:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 24 pid: 6509 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448404.984835:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826314752 00000100:00100000:3.0:1788448404.984838:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826314752 00010000:00010000:3.0:1788448404.984850:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 25 pid: 6511 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448404.984863:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448404.984871:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+25:3645:x1875323826314624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448404.984909:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448404.984915:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 25 pid: 6509 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984925:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 25 pid: 6509 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984952:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8037cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8037c5 expref: 25 pid: 6509 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.984965:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448404.985005:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826314624:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448404.985012:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448404.985028:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448404.985034:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3645:x1875323826314752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448404.985041:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448404.985046:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 23 pid: 6511 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.985054:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 23 pid: 6511 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.985064:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8600/0xf45a9e4e6b8037b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8037a9 expref: 23 pid: 6511 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.985072:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448404.985094:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3645:x1875323826314752:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448404.985100:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448404.985128:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826314752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448404.985136:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826314624:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448404.985449:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826314496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448404.985480:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448404.985559:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448404.985566:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448404.985675:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826314496 00000100:00100000:3.0:1788448404.985685:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826314496 00010000:00010000:3.0:1788448404.985704:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448404.985736:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448404.985743:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3648:x1875323826314496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448404.985752:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448404.985756:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.985765:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448404.985777:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b8037da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8037d3 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.985988:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.985998:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448404.986039:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448404.986057:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788448404.986080:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.986092:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8037b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8037be expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.986108:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448404.986110:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448404.986111:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448404.986675:0:13185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826313728:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448404.986722:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826314880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448404.986755:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448404.986850:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788448404.986859:0:6502:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788448404.987107:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826314880 00000100:00100000:0.0:1788448404.987112:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826314880 00010000:00010000:0.0:1788448404.987134:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448404.987158:0:6502:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788448404.987167:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448404.987187:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3648:x1875323826314880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448404.987199:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448404.987204:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.987213:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.987227:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8037be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8037b7 expref: 22 pid: 6510 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.987238:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448404.987268:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3648:x1875323826314880:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.987276:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788448404.988315:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3648:x1875323826314496:12345-0@lo:103:ldlm_bl.0 Request processed in 2567us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448404.988325:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788448404.988815:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826314496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448404.988844:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826314880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448404.989151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448404.989193:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062144 00000100:00100000:0.0:1788448404.989201:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062144 00010000:00010000:0.0:1788448404.989229:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 13 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448404.989265:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1788448404.989274:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801062144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448404.989286:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448404.989292:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 13 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.989303:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 13 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.989459:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b8037ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e051a expref: 13 pid: 6511 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.989473:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448404.989648:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:2398:x1875323801062144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 374us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448404.989656:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1788448404.996396:0:13185:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13185:1875323826314368:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448404.996451:0:13185:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448404.997865:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448404.997937:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062272 00000100:00100000:2.0:1788448404.997945:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062272 00010000:00010000:2.0:1788448404.997986:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448404.998020:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:2.0:1788448404.998029:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:2398:x1875323801062272:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448404.998042:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448404.998047:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998058:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998075:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8037a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04db expref: 12 pid: 6509 timeout: 422 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998092:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998115:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998129:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998135:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998142:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998149:0:13187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998155:0:13187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448404.998159:0:13187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998166:0:13187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998177:0:13187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448404.998185:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448404.998235:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2398:x1875323801062272:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 206us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448404.998242:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00010000:00010000:0.0:1788448404.998485:0:13185:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.998504:0:13185:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448404.998511:0:13185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180031400/0xf45a9e4e6b803812 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13185 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448405.502096:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448406.207906:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826315008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448406.207973:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448406.208059:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315008 00000100:00100000:1.0:1788448406.208066:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315008 00000100:00100000:1.0:1788448406.208118:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788448406.208129:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826315008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448406.208156:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448406.208199:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826315008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448406.208206:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788448406.208244:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373f100 x1875323826315008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448406.208262:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826315008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448406.208377:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448406.208401:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826315136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448406.208431:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788448406.208720:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448406.209763:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826315264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448406.209815:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448406.209926:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315264 00000100:00100000:0.0:1788448406.209933:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315264 00000100:00100000:0.0:1788448406.209981:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788448406.209990:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826315264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448406.210019:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448406.210072:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826315264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448406.210080:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788448406.210178:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826315264:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448406.210260:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315136 00000100:00100000:1.0:1788448406.210265:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315136 00000100:00100000:1.0:1788448406.210315:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788448406.210323:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826315136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448406.210336:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448406.210391:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826315136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448406.210398:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788448406.210587:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448406.210611:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373d880 x1875323826315136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448406.210624:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826315136:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788448406.528179:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448406.821418:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448406.821619:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062400 00000100:00100000:3.0:1788448406.821628:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062400 00000100:00100000:3.0:1788448406.821681:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 316 00000100:00100000:3.0:1788448406.821691:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:6171:x1875323801062400:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448406.821705:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448406.821723:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e054b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448406.821749:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448406.821759:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448406.821769:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f600, rc 0) 00000100:00100000:3.0:1788448406.821827:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801062400:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 138us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448406.821836:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 316 00000100:00100000:1.0:1788448406.829314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448406.829983:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062528 00000100:00100000:3.0:1788448406.829995:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062528 00000100:00100000:3.0:1788448406.830051:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 317 00000100:00100000:3.0:1788448406.830061:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801062528:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448406.830225:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801062528:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 164us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448406.830244:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 317 00000100:00100000:3.0:1788448406.834142:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448406.836208:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062656 00000100:00100000:1.0:1788448406.836229:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062656 00000100:00100000:1.0:1788448406.836528:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 318 00000100:00100000:1.0:1788448406.836543:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801062656:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448406.836781:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801062656:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 240us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448406.836791:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 318 10000000:01000000:2.0:1788448406.846425:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448406.846432:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bf749000 from 7 10000000:01000000:2.0:1788448406.846437:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448406.846493:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.846505:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.846517:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448406.846540:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.846600:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448406.846655:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08364bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448406.846722:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315392 00000100:00100000:3.0:1788448406.846742:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315392 00000100:00100000:3.0:1788448406.846794:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788448406.846803:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826315392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448406.846814:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448406.846825:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803820 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448406.846845:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448406.846856:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448406.846864:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152ec00, rc 0) 00000100:00100000:3.0:1788448406.846929:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826315392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448406.846936:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788448406.847381:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448406.847536:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.847551:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448406.847651:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.847714:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448406.847763:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448406.849089:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315520 00000100:00100000:3.0:1788448406.849113:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315520 00000100:00100000:3.0:1788448406.849172:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788448406.849180:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826315520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448406.849444:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826315520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (1729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448406.849453:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788448406.849643:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.849724:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.849813:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448406.849851:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448406.849877:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315648 00000100:00100000:0.0:1788448406.850618:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315648 00000100:00100000:0.0:1788448406.850692:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788448406.850704:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826315648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.850859:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826315648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448406.850868:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788448406.851116:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448406.851153:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062784 00000100:00100000:2.0:1788448406.851160:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062784 00000100:00100000:0.0:1788448406.851689:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788448406.855679:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000100:00100000:2.0:1788448406.861298:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 322 00000100:00100000:2.0:1788448406.861319:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801062784:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448406.861339:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448406.861359:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0552 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.861692:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.861704:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.861715:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181681a00, rc 0) 00000100:00100000:2.0:1788448406.861777:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801062784:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 466us (10668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.861787:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 322 00000020:01000000:1.0:1788448406.862074:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788448406.862106:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448406.862115:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.862132:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448406.862143:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448406.862146:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1ba23b000 from 7 10000000:01000000:1.0:1788448406.862149:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448406.862180:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.862188:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.862207:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448406.862229:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448406.862292:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448406.862336:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448406.862607:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315776 00000100:00100000:2.0:1788448406.862614:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315776 00000100:00100000:2.0:1788448406.862653:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788448406.862661:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826315776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448406.862670:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448406.862680:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803835 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.862698:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.862707:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.862713:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc181680000, rc 0) 00000100:00100000:2.0:1788448406.862748:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826315776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.862763:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788448406.862804:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448406.862819:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.862828:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448406.862917:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.862943:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448406.862964:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08364b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448406.862980:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826315904 00000100:00100000:2.0:1788448406.862983:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826315904 00000100:00100000:2.0:1788448406.863011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788448406.863019:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826315904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.863139:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826315904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.863146:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788448406.863524:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826315904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.863552:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.863593:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448406.863612:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448406.863659:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316032 00000100:00100000:2.0:1788448406.863662:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316032 00000100:00100000:2.0:1788448406.863690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788448406.863696:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826316032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.863765:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826316032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.863771:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1788448406.863984:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.865174:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448406.865529:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801062912 00000100:00100000:2.0:1788448406.865536:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801062912 00000100:00100000:2.0:1788448406.865577:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 326 00000100:00100000:2.0:1788448406.865585:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801062912:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.865699:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801062912:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 114us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.865707:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 326 00000040:00080000:0.0:1788448406.866995:0:13218:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788448406.867208:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788448406.867252:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448406.867262:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.867274:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448406.867284:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448406.867286:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc19ea22000 from 7 10000000:01000000:1.0:1788448406.867289:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448406.867317:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.867325:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.867335:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448406.867356:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448406.867581:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448406.867623:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448406.867668:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316160 00000100:00100000:0.0:1788448406.867674:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316160 00000100:00100000:0.0:1788448406.867714:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788448406.867723:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826316160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448406.867733:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448406.867744:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803843 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.867764:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.867774:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.867783:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e000, rc 0) 00000100:00100000:0.0:1788448406.867822:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826316160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448406.867830:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788448406.868047:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448406.868062:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448406.868070:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448406.868145:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448406.868170:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448406.868187:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448406.868357:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316288 00000100:00100000:2.0:1788448406.868362:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316288 00000100:00100000:2.0:1788448406.868578:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788448406.868585:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826316288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.868680:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826316288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.868688:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788448406.868719:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.868746:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.868782:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448406.868794:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08364b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448406.868805:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316416 00000100:00100000:2.0:1788448406.868808:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316416 00000100:00100000:2.0:1788448406.868827:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788448406.868833:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826316416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.868924:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826316416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.868930:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788448406.868971:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.869573:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448406.869652:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063040 00000100:00100000:2.0:1788448406.869657:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063040 00000100:00100000:2.0:1788448406.869688:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 330 00000100:00100000:2.0:1788448406.869696:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801063040:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.869810:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801063040:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 114us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.869817:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 330 00000040:00080000:0.0:1788448406.870740:0:13219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788448406.871037:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788448406.871068:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448406.871076:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.871087:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448406.871108:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448406.871111:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc190ac6000 from 7 10000000:01000000:2.0:1788448406.871114:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448406.871152:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.871161:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.871171:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448406.871190:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448406.871541:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448406.871577:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08364bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448406.871826:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316544 00000100:00100000:0.0:1788448406.871832:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316544 00000100:00100000:0.0:1788448406.871862:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788448406.871878:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826316544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448406.871902:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448406.871912:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b803851 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.871933:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.871943:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.871951:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e600, rc 0) 00000100:00100000:0.0:1788448406.871988:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826316544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448406.871994:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788448406.872032:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448406.872045:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448406.872054:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448406.872116:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.872151:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448406.872166:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448406.872177:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316672 00000100:00100000:0.0:1788448406.872181:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316672 00000100:00100000:0.0:1788448406.872202:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788448406.872216:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826316672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.872722:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826316672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 505us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448406.872730:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788448406.872762:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.872788:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.872822:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448406.872840:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448406.872849:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316800 00000100:00100000:0.0:1788448406.872853:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316800 00000100:00100000:0.0:1788448406.872872:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788448406.872877:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826316800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448406.872962:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826316800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448406.872968:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788448406.873001:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826316800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788448406.875539:0:13220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788448406.876312:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788448406.876336:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448406.876346:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448406.876359:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448407.550432:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448408.264228:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826317056:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264292:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264343:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826317568:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264362:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264408:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826318080:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264427:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264453:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788448408.264460:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826316928:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264493:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264517:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826317440:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264537:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264553:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826317952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264573:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264588:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.264636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317056 00000100:00100000:2.0:1788448408.264650:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317056 00000100:00100000:2.0:1788448408.264690:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317568 00000100:00100000:2.0:1788448408.264694:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317568 00000100:00100000:2.0:1788448408.264714:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318080 00000100:00100000:2.0:1788448408.264716:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318080 00000100:00100000:2.0:1788448408.264731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788448408.264739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826317056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264787:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826317056:12345-0@lo:400:kworker.0 Request processed in 48us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.264795:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788448408.264811:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788448408.264818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826317568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264843:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826317568:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.264849:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788448408.264860:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788448408.264865:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826318080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.264912:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826318080:12345-0@lo:400:kworker.0 Request processed in 46us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.264917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788448408.264940:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317440 00000100:00100000:2.0:1788448408.264943:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317440 00000100:00100000:2.0:1788448408.264966:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788448408.264972:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826317440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.265000:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826317440:12345-0@lo:400:kworker.0 Request processed in 28us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.265007:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788448408.265032:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317952 00000100:00100000:2.0:1788448408.265036:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317952 00000100:00100000:2.0:1788448408.265058:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318464 00000100:00100000:2.0:1788448408.265060:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318464 00000100:00100000:2.0:1788448408.265379:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448408.265386:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826317952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.265492:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826317952:12345-0@lo:400:kworker.0 Request processed in 105us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.265498:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448408.265509:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448408.265516:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826318464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.265559:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826318464:12345-0@lo:400:kworker.0 Request processed in 44us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.265565:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788448408.265588:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448408.265592:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448408.265595:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448408.265629:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826317440:0@lo:400:kworker.0 00010000:00080000:2.0:1788448408.265642:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9880 x1875323826317952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448408.265652:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826317952:0@lo:400:kworker.0 00010000:00080000:2.0:1788448408.265661:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823fa300 x1875323826318464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448408.265669:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826318464:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.265679:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826317056:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.265703:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826317568:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.265712:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826318080:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.268579:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826316928 00000100:00100000:0.0:1788448408.268592:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826316928 00000100:00100000:0.0:1788448408.268761:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788448408.268771:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826316928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.268847:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826316928:12345-0@lo:400:kworker.0 Request processed in 78us (4352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.268855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788448408.268918:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826317184:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.270305:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826316928:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.271618:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.271734:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826317696:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.271778:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.271800:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826318208:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.271823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.271846:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788448408.271852:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826317312:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.271872:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.271904:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826317824:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.271933:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.271951:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826318336:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.271971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.272011:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317696 00000100:00100000:0.0:1788448408.272019:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317696 00000100:00100000:1.0:1788448408.272971:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317824 00000100:00100000:1.0:1788448408.272978:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317824 00000100:00100000:1.0:1788448408.273012:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318336 00000100:00100000:1.0:1788448408.273015:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318336 00000100:00100000:1.0:1788448408.273038:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788448408.273045:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826317824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.274845:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788448408.274865:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826318336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.274961:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826318336:12345-0@lo:400:kworker.0 Request processed in 105us (2988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.274968:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788448408.275056:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318208 00000100:00100000:0.0:1788448408.275187:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318208 00000100:00100000:0.0:1788448408.275218:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317312 00000100:00100000:0.0:1788448408.275222:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317312 00000100:00100000:0.0:1788448408.275234:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788448408.275242:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826317696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.275277:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826317696:12345-0@lo:400:kworker.0 Request processed in 37us (3499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.275283:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788448408.275298:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788448408.275305:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826318208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.275333:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826318208:12345-0@lo:400:kworker.0 Request processed in 29us (3509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.275350:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788448408.275364:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788448408.275370:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826317312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.275405:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826317312:12345-0@lo:400:kworker.0 Request processed in 36us (3533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.275412:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788448408.275465:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826317312:0@lo:400:kworker.0 00010000:00080000:0.0:1788448408.275492:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9f80 x1875323826318336/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448408.275503:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826318336:0@lo:400:kworker.0 00010000:00080000:0.0:1788448408.275516:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137d500 x1875323826317696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448408.275524:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826317696:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.277286:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5e8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826317824:12345-0@lo:400:kworker.0 Request processed in 4233us (5343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448408.277297:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788448408.277504:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826317184 00000100:00100000:1.0:1788448408.277511:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826317184 00010000:00080000:0.0:1788448408.278406:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823faa00 x1875323826318208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448408.278418:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826318208:0@lo:400:kworker.0 00010000:00080000:0.0:1788448408.278725:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0823f9180 x1875323826317824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448408.278735:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826317824:0@lo:400:kworker.0 00000100:00080000:0.0:1788448408.278770:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448408.278776:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448408.278779:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448408.279358:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788448408.279371:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826317184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.279462:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826317184:12345-0@lo:400:kworker.0 Request processed in 94us (7847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448408.279469:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788448408.279554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826317184:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.432430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448408.432471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448408.432506:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448408.432528:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448408.432548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448408.432574:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063424 00000100:00100000:0.0:1788448408.432583:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063424 00000100:00100000:0.0:1788448408.432630:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063680 00000100:00100000:0.0:1788448408.432633:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063680 00000100:00100000:0.0:1788448408.432646:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063296 00000100:00100000:0.0:1788448408.432649:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063296 00000100:00100000:0.0:1788448408.432661:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063552 00000100:00100000:0.0:1788448408.432663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063552 00000100:00100000:0.0:1788448408.432679:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 204 00000100:00100000:0.0:1788448408.432690:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801063424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448408.432755:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801063424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.432763:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 204 00000100:00100000:0.0:1788448408.432782:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:0.0:1788448408.432789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801063680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448408.432813:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801063680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.432819:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:0.0:1788448408.432830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 206 00000100:00100000:0.0:1788448408.432837:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801063296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448408.432870:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801063296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.432877:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 206 00000100:00100000:0.0:1788448408.432915:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:0.0:1788448408.432923:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801063552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448408.432946:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801063552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.432952:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00080000:0.0:1788448408.432978:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448408.432981:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448408.433341:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063168 00000100:00100000:3.0:1788448408.433346:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063168 00000100:00100000:3.0:1788448408.433388:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 335 00000100:00100000:3.0:1788448408.433405:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801063168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448408.433454:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801063168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 51us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448408.433461:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 335 00010000:00010000:3.0:1788448408.574226:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448408.766101:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826318592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448408.766162:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448408.766267:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318592 00000100:00100000:1.0:1788448408.766274:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318592 00000100:00100000:1.0:1788448408.766322:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788448408.766344:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826318592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448408.766371:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448408.768933:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448408.769977:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826318592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3640us (3808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448408.769990:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:0.0:1788448408.770100:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d50700 x1875323826318592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448408.770122:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826318592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448408.771452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826318720:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448408.771607:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.771648:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318720 00000100:00100000:0.0:1788448408.771656:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318720 00000100:00100000:0.0:1788448408.771706:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788448408.771715:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826318720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448408.771735:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448408.771781:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826318720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.771788:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:3.0:1788448408.771853:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4894700 x1875323826318720/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448408.771874:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826318720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448409.278500:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826318848:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448409.278564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448409.278633:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318848 00000100:00100000:1.0:1788448409.278640:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318848 00000100:00100000:1.0:1788448409.278683:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448409.278691:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826318848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448409.278724:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448409.278766:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826318848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448409.278772:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448409.278830:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826318848:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448409.598097:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448410.600502:0:13385:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788448410.625117:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448411.326162:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826318976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448411.326230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448411.327279:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826318976 00000100:00100000:1.0:1788448411.327288:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826318976 00000100:00100000:1.0:1788448411.327327:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788448411.327349:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826318976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448411.327381:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788448411.327432:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826318976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448411.327452:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788448411.327523:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826318976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448411.327905:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448411.327916:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826319104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448411.327952:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448411.328032:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319104 00000100:00100000:0.0:1788448411.328037:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319104 00000100:00100000:0.0:1788448411.328097:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788448411.328104:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826319104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448411.328123:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448411.328171:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826319104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448411.328177:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788448411.328289:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448411.328313:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083418e00 x1875323826319104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448411.328327:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826319104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448411.328706:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448411.328717:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826319232:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448411.328760:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448411.328988:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319232 00000100:00100000:2.0:1788448411.328994:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319232 00000100:00100000:2.0:1788448411.329030:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448411.329038:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826319232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448411.329050:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448411.329096:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826319232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448411.329102:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788448411.329250:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448411.329822:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4896d80 x1875323826319232/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448411.329839:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826319232:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788448411.646738:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448412.676863:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448413.375105:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826319744:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375217:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826320256:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375243:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375271:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826320768:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375290:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375311:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788448413.375317:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826319360:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375342:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375364:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826319872:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375397:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826320384:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375414:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375476:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826319488:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375498:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375525:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826320000:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375560:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375576:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826320512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375613:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788448413.375618:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826319616:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375654:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826320128:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375672:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375682:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826320640:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.375723:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319744 00000100:00100000:0.0:1788448413.375731:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319744 00000100:00100000:0.0:1788448413.375779:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319488 00000100:00100000:0.0:1788448413.375783:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319488 00000100:00100000:0.0:1788448413.375795:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320000 00000100:00100000:0.0:1788448413.375798:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320000 00000100:00100000:0.0:1788448413.375819:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320512 00000100:00100000:0.0:1788448413.375822:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320512 00000100:00100000:0.0:1788448413.375831:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320128 00000100:00100000:0.0:1788448413.375833:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320128 00000100:00100000:0.0:1788448413.375844:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320640 00000100:00100000:0.0:1788448413.375847:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320640 00000100:00100000:0.0:1788448413.375861:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788448413.375870:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826319744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.375946:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826319744:12345-0@lo:400:kworker.0 Request processed in 76us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.375954:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788448413.375972:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788448413.375986:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826319488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826319488:12345-0@lo:400:kworker.0 Request processed in 35us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376026:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788448413.376039:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788448413.376045:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826320000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376074:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826320000:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376079:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788448413.376091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788448413.376096:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826320512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376120:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826320512:12345-0@lo:400:kworker.0 Request processed in 24us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376125:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788448413.376136:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788448413.376142:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826320128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376168:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826320128:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376173:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788448413.376183:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788448413.376189:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376215:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826320640:12345-0@lo:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376221:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788448413.376241:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320256 00000100:00100000:0.0:1788448413.376250:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320256 00000100:00100000:0.0:1788448413.376270:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320768 00000100:00100000:0.0:1788448413.376273:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320768 00000100:00100000:0.0:1788448413.376282:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320384 00000100:00100000:0.0:1788448413.376285:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320384 00000100:00100000:0.0:1788448413.376295:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826320896 00000100:00100000:0.0:1788448413.376297:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826320896 00000100:00100000:0.0:1788448413.376309:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448413.376314:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826320256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376343:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826320256:12345-0@lo:400:kworker.0 Request processed in 29us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376349:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448413.376360:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448413.376365:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376389:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826320768:12345-0@lo:400:kworker.0 Request processed in 24us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448413.376405:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448413.376412:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826320384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376434:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826320384:12345-0@lo:400:kworker.0 Request processed in 24us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376440:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448413.376463:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788448413.376470:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376495:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826320896:12345-0@lo:400:kworker.0 Request processed in 26us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.376499:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788448413.376535:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448413.376539:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448413.376541:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448413.376543:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788448413.376571:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5f80 x1875323826320384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.376584:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826320384:0@lo:400:kworker.0 00010000:00080000:0.0:1788448413.376594:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0825c2300 x1875323826320896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.376602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376611:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826319744:0@lo:400:kworker.0 00010000:00080000:0.0:1788448413.376620:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5c00 x1875323826320256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.376627:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826320256:0@lo:400:kworker.0 00010000:00080000:0.0:1788448413.376635:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5880 x1875323826320768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.376642:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826320768:0@lo:400:kworker.0 00010000:00080000:0.0:1788448413.376678:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5500 x1875323826320128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.376686:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826320128:0@lo:400:kworker.0 00010000:00080000:0.0:1788448413.376695:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e7100 x1875323826320640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.376703:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826320640:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376721:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826319488:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376730:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826320000:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.376738:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826320512:0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.377004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319872 00000100:00100000:1.0:1788448413.377010:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319872 00000100:00100000:1.0:1788448413.377032:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319616 00000100:00100000:1.0:1788448413.377035:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319616 00000100:00100000:1.0:1788448413.377048:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788448413.377054:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826319872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.377098:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826319872:12345-0@lo:400:kworker.0 Request processed in 45us (1713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448413.377104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788448413.377116:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448413.377122:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826319616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.377156:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826319616:12345-0@lo:400:kworker.0 Request processed in 35us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448413.377162:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448413.377193:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826319616:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.378623:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826319872:0@lo:400:kworker.0 00000100:00100000:2.0:1788448413.378803:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826319360 00000100:00100000:2.0:1788448413.378811:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826319360 00000100:00100000:2.0:1788448413.378859:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788448413.378868:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826319360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448413.378954:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826319360:12345-0@lo:400:kworker.0 Request processed in 87us (3610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448413.378972:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788448413.379025:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826319360:0@lo:400:kworker.0 00000100:00100000:2.0:1788448413.550141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448413.550265:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448413.550292:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448413.550310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448413.550332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448413.550357:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063936 00000100:00100000:2.0:1788448413.550365:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063936 00000100:00100000:2.0:1788448413.550411:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064192 00000100:00100000:2.0:1788448413.550415:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064192 00000100:00100000:2.0:1788448413.550428:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064064 00000100:00100000:2.0:1788448413.550431:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064064 00000100:00100000:2.0:1788448413.550442:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064320 00000100:00100000:2.0:1788448413.550444:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064320 00000100:00100000:2.0:1788448413.550479:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:2.0:1788448413.550489:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801063936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448413.550556:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801063936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448413.550564:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:2.0:1788448413.550581:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:2.0:1788448413.550588:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801064192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448413.550612:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801064192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448413.550618:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:2.0:1788448413.550629:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:2.0:1788448413.550645:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801064064:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448413.550669:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801064064:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448413.550676:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:2.0:1788448413.550686:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:2.0:1788448413.550692:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801064320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448413.550712:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801064320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448413.550718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:2.0:1788448413.550735:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801063808 00000100:00100000:2.0:1788448413.550738:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801063808 00000100:00100000:2.0:1788448413.550763:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 337 00000100:00100000:2.0:1788448413.550769:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801063808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448413.551179:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801063808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 407us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448413.551187:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 337 00000100:00080000:2.0:1788448413.551220:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448413.551224:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448413.694247:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448413.886197:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826321024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448413.886286:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448413.886523:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321024 00000100:00100000:3.0:1788448413.886544:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321024 00000100:00100000:3.0:1788448413.886607:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788448413.886621:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826321024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448413.886660:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448413.886705:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826321024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448413.886712:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788448413.886760:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826321152:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448413.886833:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448413.886925:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321152 00000100:00100000:1.0:1788448413.886933:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321152 00000100:00100000:1.0:1788448413.886980:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788448413.886990:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826321152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448413.887006:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:0.0:1788448413.887021:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b5d53480 x1875323826321024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.887048:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826321024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448413.887067:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826321152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 77us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448413.887076:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:0.0:1788448413.887118:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137fb80 x1875323826321152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.887134:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826321152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448414.398178:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448414.398201:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826321280:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448414.398266:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448414.398495:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321280 00000100:00100000:3.0:1788448414.398504:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321280 00000100:00100000:3.0:1788448414.398554:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788448414.398564:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826321280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448414.398596:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788448414.398644:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826321280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448414.398651:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788448414.399056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826321280:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788448414.723858:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448415.742217:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448416.446559:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448416.446580:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826321408:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448416.446650:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448416.446707:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321408 00000100:00100000:2.0:1788448416.446713:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321408 00000100:00100000:2.0:1788448416.446754:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788448416.446763:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826321408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448416.446801:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448416.446845:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826321408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448416.446852:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788448416.446919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826321408:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448416.447163:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826321536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448416.447199:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448416.447531:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321536 00000100:00100000:2.0:1788448416.447536:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321536 00000100:00100000:2.0:1788448416.447630:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788448416.447638:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826321536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448416.447657:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448416.447692:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826321536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448416.447698:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00080000:2.0:1788448416.447729:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137fb80 x1875323826321536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448416.447744:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826321536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448416.448827:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448416.448839:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826321664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448416.448908:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448416.449000:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321664 00000100:00100000:3.0:1788448416.449005:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321664 00000100:00080000:1.0:1788448416.449206:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448416.449389:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788448416.449398:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826321664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448416.449413:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448416.449474:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826321664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448416.449480:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:0.0:1788448416.449612:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0825c2d80 x1875323826321664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448416.449627:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826321664:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788448416.767234:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448416.983679:0:13535:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:13:35 (1788448415) === 00000100:00100000:1.0:1788448417.210702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448417.210782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448417.210928:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064576 00000100:00100000:3.0:1788448417.210937:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064576 00000100:00100000:3.0:1788448417.211002:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:3.0:1788448417.211014:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:10498:x1875323801064576:12345-192.168.206.21@tcp:700:mkdir.0 00000100:00100000:3.0:1788448417.211094:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:10498:x1875323801064576:12345-192.168.206.21@tcp:700:mkdir.0 Request processed in 83us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448417.211115:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00080000:1.0:1788448417.211338:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448417.211551:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064448 00000100:00100000:2.0:1788448417.211557:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064448 00000100:00100000:2.0:1788448417.211632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788448417.211642:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801064448:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:2.0:1788448417.211670:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788448417.211728:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801064448:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 88us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448417.211735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788448417.224793:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.224922:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064832 00000100:00100000:0.0:1788448417.224932:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064832 00000100:00100000:0.0:1788448417.225145:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1788448417.225156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:10498:x1875323801064832:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:0.0:1788448417.225217:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448417.225288:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc181680c00/0xf45a9e4e6b803701 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04c6 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.225315:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1a0b31100) 00010000:00010000:0.0:1788448417.225326:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448417.225407:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.225421:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.225440:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.233553:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.233576:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.233589:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234199:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234211:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234219:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448417.234236:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000616a5962 reply state 000000006674a686 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234246:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234253:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:2.0:1788448417.234256:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448417.234260:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788448417.234266:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788448417.234274:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234280:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234293:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234298:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448417.234302:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234309:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234320:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336b300) 00010000:00010000:2.0:1788448417.234323:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448417.234326:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234332:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b80385f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448417.234350:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000616a5962 reply state 000000006674a686 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234358:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.234364:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc1a0b31300) 00010000:00010000:2.0:1788448417.234367:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448417.234368:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788448417.234477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:10498:x1875323801064832:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 9318us (9689us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788448417.234486:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:2.0:1788448417.245264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.246114:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801064960 00000100:00100000:0.0:1788448417.246130:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801064960 00000100:00100000:0.0:1788448417.246215:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:0.0:1788448417.246229:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:10499:x1875323801064960:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788448417.246257:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448417.246288:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803874 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0559 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.246385:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80387b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.246402:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80387b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.246444:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80387b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448417.246502:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788448417.246507:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448417.246551:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80387b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.246585:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803874 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0559 expref: 9 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.246608:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80387b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0559 expref: 8 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.246617:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336bf00) 00010000:00010000:0.0:1788448417.246621:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448417.246625:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448417.246716:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:10499:x1875323801064960:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 490us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448417.246724:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:3.0:1788448417.251704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448417.251849:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801065216 00000100:00100000:1.0:1788448417.251864:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801065216 00000100:00100000:0.0:1788448417.256195:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:0.0:1788448417.256222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:10499:x1875323801065216:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788448417.256301:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448417.256463:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80387b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0559 expref: 8 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.256488:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336bf00) 00010000:00010000:0.0:1788448417.256521:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448417.256559:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.256574:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.256586:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448417.256858:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081127047 reply state 00000000621e2ada transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.256873:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.257061:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:0.0:1788448417.257065:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788448417.257068:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788448417.257078:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788448417.257201:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:10499:x1875323801065216:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 989us (5511us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788448417.257210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1788448417.311669:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.311785:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801065344 00000100:00100000:0.0:1788448417.311800:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801065344 00000100:00100000:0.0:1788448417.311936:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:0.0:1788448417.311951:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:10500:x1875323801065344:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788448417.311992:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448417.312642:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803889 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0560 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.312775:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803890 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.312792:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.312804:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448417.312857:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788448417.312861:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448417.312931:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803890 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.312966:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803889 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0560 expref: 11 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.312988:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803890 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0560 expref: 10 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.312997:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:0.0:1788448417.313000:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448417.313004:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f600, rc 0) 00000100:00100000:0.0:1788448417.314234:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:10500:x1875323801065344:12345-192.168.206.21@tcp:101:chown.0 Request processed in 2277us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448417.314246:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1788448417.322181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448417.324292:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801065472 00000100:00100000:3.0:1788448417.324315:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801065472 00000100:00100000:3.0:1788448417.324420:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1788448417.324442:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:10500:x1875323801065472:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788448417.324469:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448417.324499:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803897 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0567 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324581:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324599:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324614:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324629:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324637:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324643:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324748:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b8038ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324777:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b8038ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324783:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b8038ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448417.324837:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448417.324842:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448417.324962:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b8038ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324980:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324988:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.324995:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325002:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448417.325007:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325016:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325032:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:3.0:1788448417.325036:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448417.325041:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325060:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b80389e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325082:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325089:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325095:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325100:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448417.325104:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325110:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325119:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc1a0b31300) 00010000:00010000:3.0:1788448417.325122:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448417.325125:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325132:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038a5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325167:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803897 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0567 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325183:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b8038ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0567 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.325198:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:3.0:1788448417.325201:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448417.325203:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8600, rc 0) 00000100:00100000:3.0:1788448417.325300:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:10500:x1875323801065472:12345-192.168.206.21@tcp:101:chown.0 Request processed in 859us (3133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448417.325311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1788448417.332141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.345187:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801065600 00000100:00100000:2.0:1788448417.345208:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801065600 00000100:00100000:2.0:1788448417.345369:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:2.0:1788448417.345385:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:10500:x1875323801065600:12345-192.168.206.21@tcp:900:chown.0 00000100:00100000:2.0:1788448417.345507:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:10500:x1875323801065600:12345-192.168.206.21@tcp:900:chown.0 Request processed in 125us (13381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448417.345515:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:2.0:1788448417.353165:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.353469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801065856 00000100:00100000:0.0:1788448417.353483:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801065856 00000100:00100000:0.0:1788448417.353579:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1788448417.353590:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:10500:x1875323801065856:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:0.0:1788448417.353662:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448417.353697:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b8038ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0567 expref: 11 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.353724:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:0.0:1788448417.353729:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448417.353761:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.353778:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.353790:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448417.358353:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1788448417.358590:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087ccde3f reply state 00000000f31a355a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.358619:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.358630:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:2.0:1788448417.358633:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788448417.358639:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788448417.358655:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788448417.358785:0:6518:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788448417.358816:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:10500:x1875323801065856:12345-192.168.206.21@tcp:36:chown.0 Request processed in 5221us (5660us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788448417.358826:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00010000:00010000:0.0:1788448417.359098:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359109:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359117:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359124:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ba00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.359130:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359138:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359161:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc1a0b31300) 00010000:00010000:0.0:1788448417.359165:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448417.359178:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359186:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b803866 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359209:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359215:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359221:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359227:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.359230:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359235:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359244:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:0.0:1788448417.359247:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448417.359250:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359255:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b80386d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359280:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359286:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359292:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359298:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.359301:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359307:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359316:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:0.0:1788448417.359319:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448417.359322:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.359328:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803882 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.365896:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.365929:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.365939:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.365947:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448417.365954:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.365966:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.365991:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:3.0:1788448417.365994:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788448417.365999:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.366006:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8038b3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448417.386331:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.386830:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801065984 00000100:00100000:0.0:1788448417.386846:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801065984 00000100:00100000:0.0:1788448417.386997:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:0.0:1788448417.387011:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:10501:x1875323801065984:12345-192.168.206.21@tcp:101:touch.500 00010000:00010000:0.0:1788448417.387044:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448417.387264:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b8038ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e056e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448417.389120:0:6519:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1758us 00010000:00010000:3.0:1788448417.420610:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420638:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420653:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420672:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420679:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420687:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420862:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8038cf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420871:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8038cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.420902:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8038cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448417.420940:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448417.420944:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448417.421002:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8038cf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421017:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421034:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421042:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421049:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448417.421054:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421062:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421077:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:3.0:1788448417.421081:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448417.421085:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421092:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b8038c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421104:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421111:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421117:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421128:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448417.421131:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421138:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421146:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc1c1293c00) 00010000:00010000:3.0:1788448417.421148:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448417.421151:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421157:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b8038c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421201:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b8038ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e056e expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421219:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8038cf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e056e expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.421227:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:3.0:1788448417.421230:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788448417.421232:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9c00, rc 0) 00000100:00100000:3.0:1788448417.421521:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:10501:x1875323801065984:12345-192.168.206.21@tcp:101:touch.500 Request processed in 34511us (35217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448417.421532:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1788448417.436123:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.438817:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801066240 00000100:00100000:2.0:1788448417.438840:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801066240 00000100:00100000:2.0:1788448417.438962:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1788448417.438976:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:10501:x1875323801066240:12345-192.168.206.21@tcp:101:touch.500 00010000:00010000:2.0:1788448417.439004:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448417.439051:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b8038d6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0575 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.439221:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.439239:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.439252:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.439270:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.439278:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.439284:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448417.439846:0:9023:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788448417.440073:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b8038eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440084:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b8038eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440093:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b8038eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440132:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440150:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440157:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440163:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448417.440168:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440176:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440191:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:2.0:1788448417.440195:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448417.440200:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440207:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b8038dd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448417.440224:0:9023:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000398f69e9 reply state 000000006110551e transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440236:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440242:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9fc1a0b31500) 00010000:00010000:2.0:1788448417.440244:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448417.440247:0:9023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788448417.440287:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330600/0xf45a9e4e6b8038d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0575 expref: 10 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440309:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b8038eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0575 expref: 9 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.440318:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31400) 00010000:00010000:2.0:1788448417.440320:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448417.440323:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330200, rc 0) 00000100:00100000:2.0:1788448417.440442:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:10501:x1875323801066240:12345-192.168.206.21@tcp:101:touch.500 Request processed in 1467us (4334us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788448417.440453:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:1.0:1788448417.444048:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.444285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801066496 00000100:00100000:2.0:1788448417.444298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801066496 00000100:00100000:2.0:1788448417.444368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:2.0:1788448417.444379:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:10501:x1875323801066496:12345-192.168.206.21@tcp:36:touch.500 00010000:00010000:2.0:1788448417.444465:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448417.444497:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b8038eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0575 expref: 10 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.444518:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31400) 00010000:00010000:2.0:1788448417.444531:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448417.444594:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.444608:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.444618:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448417.444766:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a06dd12 reply state 000000000caad9a0 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.444779:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.444784:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:2.0:1788448417.444787:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448417.444789:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448417.444921:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:10501:x1875323801066496:12345-192.168.206.21@tcp:36:touch.500 Request processed in 542us (888us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788448417.444928:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:3.0:1788448417.459372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.459575:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801066624 00000100:00100000:2.0:1788448417.459588:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801066624 00000100:00100000:2.0:1788448417.459720:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:2.0:1788448417.459733:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:10501:x1875323801066624:12345-192.168.206.21@tcp:101:touch.500 00010000:00010000:2.0:1788448417.459777:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448417.459804:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803900 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e057c expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.459932:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803900 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e057c expref: 12 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.459949:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803900 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e057c expref: 12 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.459974:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:2.0:1788448417.459986:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448417.459992:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330200, rc 0) 00000100:00100000:2.0:1788448417.460062:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:10501:x1875323801066624:12345-192.168.206.21@tcp:101:touch.500 Request processed in 332us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448417.460070:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:1.0:1788448417.469297:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.473979:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801066752 00000100:00100000:0.0:1788448417.474001:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801066752 00000100:00100000:1.0:1788448417.481238:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1788448417.481273:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2397:x1875323801066752:12345-192.168.206.21@tcp:8:touch.500 00010000:00080000:1.0:1788448417.481323:0:8434:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 334 last 0 00000020:00000080:1.0:1788448417.481370:0:8434:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b803907 00002000:00100000:1.0:1788448417.481387:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f39813a-d0bd-49ee-95eb-2130028b48f0/ffff9fc082763800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448417.481400:0:8434:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788448417.481517:0:8434:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788448417.481558:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9fc082763000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448417.481659:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801066752:12345-192.168.206.21@tcp:8:touch.500 Request processed in 388us (12375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448417.481669:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:2.0:1788448417.486230:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448417.486319:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801066880 00000100:00100000:3.0:1788448417.486332:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801066880 00000100:00100000:3.0:1788448417.486418:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:3.0:1788448417.486440:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801066880:12345-192.168.206.21@tcp:2:touch.500 00000100:00080000:2.0:1788448417.486735:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788448417.508764:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:2.0:1788448417.508786:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000100:00100000:3.0:1788448417.509072:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:0:x1875323801066880:12345-192.168.206.21@tcp:2:touch.500 Request processed in 22635us (22848us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788448417.509087:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:3.0:1788448417.518511:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.519410:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801067136 00000100:00100000:2.0:1788448417.519421:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801067136 00000100:00100000:2.0:1788448417.519491:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1788448417.519502:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:10501:x1875323801067136:12345-192.168.206.21@tcp:35:touch.500 00000100:00100000:2.0:1788448417.519765:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:10501:x1875323801067136:12345-192.168.206.21@tcp:35:touch.500 Request processed in 264us (1266us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788448417.519773:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1788448417.545120:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.546295:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801067264 00000100:00100000:2.0:1788448417.546439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801067264 00000100:00100000:3.0:1788448417.546568:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1788448417.546579:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:10502:x1875323801067264:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788448417.546603:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448417.546624:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b80390e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0583 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.546691:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b803915 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.546704:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b803915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.546715:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b803915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448417.546755:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448417.546759:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448417.546796:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b803915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.546824:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b80390e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0583 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.546856:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b803915 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0583 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.546864:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:3.0:1788448417.546867:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448417.546871:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8000, rc 0) 00000100:00100000:3.0:1788448417.546959:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:10502:x1875323801067264:12345-192.168.206.21@tcp:101:rm.0 Request processed in 381us (1848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448417.546967:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:1.0:1788448417.555550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.555647:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801067520 00000100:00100000:0.0:1788448417.555658:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801067520 00000100:00100000:0.0:1788448417.555730:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:0.0:1788448417.555740:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:10502:x1875323801067520:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788448417.555761:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448417.555782:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b80391c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e058a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448417.555878:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788448417.556060:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b80391c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e058a expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.556075:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:0.0:1788448417.556079:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448417.556084:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b80391c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e058a expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.556098:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fe00, rc 0) 00000100:00100000:0.0:1788448417.556148:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:10502:x1875323801067520:12345-192.168.206.21@tcp:101:rm.0 Request processed in 409us (608us total) trans 4294967305 rc 301/301 00000100:00100000:0.0:1788448417.556155:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:2.0:1788448417.575081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.575238:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801067648 00000100:00100000:0.0:1788448417.575248:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801067648 00000100:00100000:0.0:1788448417.575310:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:0.0:1788448417.575335:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:10502:x1875323801067648:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:0.0:1788448417.596475:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:10502:x1875323801067648:12345-192.168.206.21@tcp:37:rm.0 Request processed in 21131us (21391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448417.596497:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1788448417.605774:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448417.605920:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801067904 00000100:00100000:3.0:1788448417.605930:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801067904 00000100:00100000:3.0:1788448417.605986:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1788448417.605997:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:10502:x1875323801067904:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:3.0:1788448417.606616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:10502:x1875323801067904:12345-192.168.206.21@tcp:35:rm.0 Request processed in 619us (849us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788448417.606626:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:2.0:1788448417.619470:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448417.620912:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801068160 00000100:00100000:3.0:1788448417.620924:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801068160 00000100:00100000:3.0:1788448417.620982:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:3.0:1788448417.620993:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:10502:x1875323801068160:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788448417.621018:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448417.621039:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b80392a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0591 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.621146:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b803931 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.621172:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b803931 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448417.621183:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b803931 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448417.621195:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788448417.622562:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8200/0xf45a9e4e6b80392a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0591 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.622604:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b803931 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0591 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.622614:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:0.0:1788448417.622617:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788448417.622620:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9000, rc 0) 00000100:00100000:0.0:1788448417.622864:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801068160:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1871us (3403us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788448417.622873:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:1.0:1788448417.628693:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.628777:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801068288 00000100:00100000:0.0:1788448417.628787:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801068288 00000100:00100000:0.0:1788448417.628859:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:0.0:1788448417.628911:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801068288:12345-192.168.206.21@tcp:41:rm.0 00000004:00000024:0.0:1788448417.628968:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788448417.629039:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801068288:12345-192.168.206.21@tcp:41:rm.0 Request processed in 161us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448417.629047:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:1.0:1788448417.633565:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.633717:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801068416 00000100:00100000:0.0:1788448417.633726:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801068416 00000100:00100000:0.0:1788448417.633810:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:0.0:1788448417.633831:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801068416:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788448417.633851:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448417.633872:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b80393f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0598 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.633974:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.633990:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634003:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634014:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634021:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634027:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634106:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634116:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634123:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448417.634168:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788448417.634172:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448417.634190:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634202:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634210:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634454:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634461:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634467:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.634472:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634480:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634492:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:0.0:1788448417.634495:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448417.634504:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634510:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803946 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634812:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634818:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634824:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634829:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.634832:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634838:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634847:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9fc1a0b31500) 00010000:00010000:0.0:1788448417.634849:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448417.634852:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634858:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f400/0xf45a9e4e6b80394d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634921:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b80393f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0598 expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634935:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0598 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.634954:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:0.0:1788448417.634956:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448417.634959:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ec00, rc 0) 00000100:00100000:0.0:1788448417.635016:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:10502:x1875323801068416:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1197us (1461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448417.635023:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1788448417.640925:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.641002:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801068672 00000100:00100000:0.0:1788448417.641011:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801068672 00000100:00100000:0.0:1788448417.641067:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1788448417.641077:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:10502:x1875323801068672:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788448417.641126:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788448417.641151:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803954 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0598 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641171:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803900 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e057c expref: 18 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641181:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:0.0:1788448417.641191:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8000/0xf45a9e4e6b803915 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0583 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641200:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:0.0:1788448417.641203:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448417.641234:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641262:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641271:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641294:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641303:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641310:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641403:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641411:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.641419:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448417.642067:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788448417.642078:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 334987195697ns, next at 335987193452ns, rc = 0 00010000:00010000:0.0:1788448417.642123:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642133:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642154:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642161:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642168:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642174:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642198:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448417.642359:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448417.642367:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.642374:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448417.642378:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.642385:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.642404:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:2.0:1788448417.642407:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788448417.642411:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.642417:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803970 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.642439:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448417.642440:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448417.642442:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448417.642472:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642666:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642671:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642743:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.642747:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642753:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642763:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:0.0:1788448417.642765:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788448417.642774:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642780:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803969 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642796:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642802:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642808:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642813:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448417.642815:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642821:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642830:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:0.0:1788448417.642832:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448417.642835:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642841:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80395b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448417.642850:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eecf3b9a reply state 00000000f045dda1 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642871:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448417.642878:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9fc1a0b31500) 00010000:00010000:0.0:1788448417.643453:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788448417.643457:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448417.643848:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801068672:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2768us (2963us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788448417.643857:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:1.0:1788448417.658972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448417.659067:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801068928 00000100:00100000:0.0:1788448417.659076:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801068928 00000100:00100000:0.0:1788448417.659119:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1788448417.659128:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801068928:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1788448417.659363:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:10502:x1875323801068928:12345-192.168.206.21@tcp:35:rm.0 Request processed in 235us (403us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788448417.659371:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:1.0:1788448417.663559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448417.663804:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069184 00000100:00100000:2.0:1788448417.663814:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069184 00000100:00100000:2.0:1788448417.663911:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1788448417.663922:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:10502:x1875323801069184:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788448417.663979:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788448417.664008:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b803931 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0591 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664029:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b8038cf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e056e expref: 18 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664038:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1c1293300) 00010000:00010000:2.0:1788448417.664052:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803890 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0560 expref: 17 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664061:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336ba00) 00010000:00010000:2.0:1788448417.664082:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448417.664105:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664116:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664124:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664135:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664142:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664149:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664351:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664360:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.664367:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448417.665147:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788448417.665168:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.665175:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.665190:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.665196:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448417.665201:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.665208:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666357:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9fc1a0b31400) 00010000:00010000:2.0:1788448417.666363:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788448417.666368:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666376:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803985 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666404:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666410:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666416:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666421:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448417.666435:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666457:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666466:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1a0b31000) 00010000:00010000:2.0:1788448417.666469:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448417.666472:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666477:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803977 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448417.666490:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9582353 reply state 000000007b354e2d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.666502:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448417.668389:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc1a0b31600) 00010000:00010000:2.0:1788448417.668392:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448417.668398:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448417.669311:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:10502:x1875323801069184:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5384us (5756us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788448417.669320:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00010000:00010000:1.0:1788448417.791900:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448418.494409:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826322176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494483:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.494539:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826322688:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494566:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.494595:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826323200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494634:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.494657:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788448418.494663:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826322048:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494698:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.494713:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826322560:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494730:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.494741:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826323072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.494781:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322048 00000100:00100000:2.0:1788448418.494787:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322048 00000100:00100000:2.0:1788448418.494837:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788448418.494846:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826322048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.494925:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826322048:12345-0@lo:400:kworker.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.494932:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788448418.494953:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322688 00000100:00100000:2.0:1788448418.494956:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322688 00000100:00100000:2.0:1788448418.494982:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323200 00000100:00100000:2.0:1788448418.494984:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323200 00000100:00100000:2.0:1788448418.495000:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448418.495006:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826322688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495032:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826322688:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.495037:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448418.495046:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788448418.495052:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826323200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495084:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826323200:12345-0@lo:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.495090:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788448418.495103:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448418.495106:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448418.495128:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826322048:0@lo:400:kworker.0 00010000:00080000:2.0:1788448418.495139:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796300 x1875323826322688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448418.495149:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826322688:0@lo:400:kworker.0 00010000:00080000:2.0:1788448418.495156:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797100 x1875323826323200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448418.495163:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826323200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495196:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322176 00000100:00100000:2.0:1788448418.495199:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322176 00000100:00100000:2.0:1788448418.495219:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322560 00000100:00100000:2.0:1788448418.495221:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322560 00000100:00100000:2.0:1788448418.495233:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323072 00000100:00100000:2.0:1788448418.495235:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323072 00000100:00100000:2.0:1788448418.495246:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788448418.495251:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826322176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495280:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826322176:12345-0@lo:400:kworker.0 Request processed in 30us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.495286:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788448418.495295:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788448418.495300:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826322560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495334:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826322560:12345-0@lo:400:kworker.0 Request processed in 33us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.495339:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788448418.495350:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788448418.495355:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826323072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495375:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826323072:12345-0@lo:400:kworker.0 Request processed in 20us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.495379:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:2.0:1788448418.495390:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788448418.495402:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb797b80 x1875323826322560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448418.495410:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826322560:0@lo:400:kworker.0 00010000:00080000:2.0:1788448418.495417:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796680 x1875323826323072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448418.495436:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826323072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.495446:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826322176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495606:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826321792:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495682:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826322304:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495726:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826322816:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495761:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826323328:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495786:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495811:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788448418.495817:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826321920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495860:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826322432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495878:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495912:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826322944:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.495931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.495951:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322816 00000100:00100000:0.0:1788448418.495955:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322816 00000100:00100000:0.0:1788448418.495981:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323328 00000100:00100000:0.0:1788448418.495984:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323328 00000100:00100000:0.0:1788448418.495998:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448418.496004:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826322816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496039:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826322816:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.496046:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788448418.496060:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448418.496065:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826323328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496092:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826323328:12345-0@lo:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.496098:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788448418.496111:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448418.496114:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448418.496121:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322304 00000100:00100000:0.0:1788448418.496124:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322304 00000100:00100000:0.0:1788448418.496144:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788448418.496149:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826322304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496192:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826322304:12345-0@lo:400:kworker.0 Request processed in 42us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.496198:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788448418.496228:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826322304:0@lo:400:kworker.0 00010000:00080000:0.0:1788448418.496237:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796a00 x1875323826322816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448418.496246:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826322816:0@lo:400:kworker.0 00010000:00080000:0.0:1788448418.496254:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b100 x1875323826323328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448418.496262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826323328:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496284:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321920 00000100:00100000:0.0:1788448418.496287:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321920 00000100:00100000:0.0:1788448418.496304:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322432 00000100:00100000:0.0:1788448418.496307:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322432 00000100:00100000:0.0:1788448418.496323:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826322944 00000100:00100000:0.0:1788448418.496326:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826322944 00000100:00100000:0.0:1788448418.496340:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788448418.496345:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826321920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496378:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826321920:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.496383:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788448418.496396:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788448418.496401:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826322432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496443:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826322432:12345-0@lo:400:kworker.0 Request processed in 41us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.496459:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788448418.496473:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788448418.496479:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826322944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496508:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826322944:12345-0@lo:400:kworker.0 Request processed in 30us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.496515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1788448418.496529:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448418.496545:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826321920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496556:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826322432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.496564:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826322944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.497142:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826321792 00000100:00100000:2.0:1788448418.497148:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826321792 00000100:00100000:2.0:1788448418.497175:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788448418.497182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826321792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.497924:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826321792:12345-0@lo:400:kworker.0 Request processed in 739us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.497933:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788448418.499776:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826321792:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.663857:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448418.663920:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448418.663952:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448418.663973:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448418.663994:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448418.664018:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448418.664042:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069568 00000100:00100000:0.0:1788448418.664051:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069568 00000100:00100000:0.0:1788448418.664100:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069824 00000100:00100000:0.0:1788448418.664104:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069824 00000100:00100000:0.0:1788448418.664119:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069440 00000100:00100000:0.0:1788448418.664122:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069440 00000100:00100000:0.0:1788448418.664133:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069952 00000100:00100000:0.0:1788448418.664135:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069952 00000100:00100000:0.0:1788448418.664152:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:0.0:1788448418.664167:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801069568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448418.664255:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801069568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.664263:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:0.0:1788448418.664281:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 225 00000100:00100000:0.0:1788448418.664287:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801069824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448418.665916:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801069824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1620us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.665927:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 225 00000100:00100000:0.0:1788448418.665954:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:0.0:1788448418.665963:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2399:x1875323801069440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448418.665998:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2399:x1875323801069440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (2023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.666004:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:0.0:1788448418.666016:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:0.0:1788448418.666023:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801069952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448418.666047:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801069952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.666053:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:0.0:1788448418.666077:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069696 00000100:00100000:0.0:1788448418.666083:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069696 00000100:00100000:0.0:1788448418.666118:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:0.0:1788448418.666125:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801069696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448418.666148:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801069696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (2154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.666163:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00080000:0.0:1788448418.666179:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448418.666183:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448418.666465:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801069312 00000100:00100000:2.0:1788448418.666487:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801069312 00000100:00100000:2.0:1788448418.666517:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 339 00000100:00100000:2.0:1788448418.666524:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801069312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448418.666550:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801069312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.666556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 339 00010000:00010000:0.0:1788448418.825397:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448419.006180:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448419.006206:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826323584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448419.006447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448419.006547:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323584 00000100:00100000:0.0:1788448419.006555:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323584 00000100:00100000:0.0:1788448419.006616:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448419.006626:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826323584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448419.006653:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448419.006699:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826323584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448419.006707:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788448419.006839:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448419.006873:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448419.006977:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323456 00000100:00100000:2.0:1788448419.006982:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323456 00000100:00100000:2.0:1788448419.007025:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448419.007032:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826323456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448419.007044:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448419.007079:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448419.007085:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1788448419.007319:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5880 x1875323826323456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448419.007338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826323456:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788448419.007371:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b480 x1875323826323584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448419.007382:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826323584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448419.522912:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448419.522937:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826323712:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448419.523075:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448419.523449:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323712 00000100:00100000:0.0:1788448419.523457:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323712 00000100:00100000:0.0:1788448419.523506:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788448419.523515:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826323712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448419.524470:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448419.525108:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826323712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1590us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448419.525199:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788448419.525262:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826323712:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788448419.838167:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448420.862635:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448421.567375:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448421.567396:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b5d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826323840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448421.567474:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448421.567536:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323840 00000100:00100000:3.0:1788448421.567542:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323840 00000100:00100000:3.0:1788448421.567584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788448421.567593:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826323840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448421.567622:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448421.567666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826323840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448421.567672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788448421.567713:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b5d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826323840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448421.571259:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826323968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448421.571330:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448421.571683:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826323968 00000100:00100000:1.0:1788448421.571691:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826323968 00000100:00100000:1.0:1788448421.571766:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788448421.571777:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826323968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448421.571816:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448421.571863:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826323968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448421.571870:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:3.0:1788448421.572043:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc191317100 x1875323826323968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448421.572062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826323968:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788448421.572156:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448421.578491:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826324096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448421.578575:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448421.578656:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826324096 00000100:00100000:1.0:1788448421.578664:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826324096 00000100:00100000:1.0:1788448421.578723:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448421.578732:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826324096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448421.578764:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000004:00080000:2.0:1788448421.578857:0:8537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 338923973949ns, next at 339923971054ns, rc = 0 00000100:00080000:2.0:1788448421.578900:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448421.588654:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85b480 x1875323826324096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448421.588682:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826324096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448421.588829:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826324096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 10095us (10251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448421.588840:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00010000:1.0:1788448421.886000:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448422.130559:0:13684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1788448422.911871:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448423.286980:0:13732:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd38095b0 20000000:00000080:0.0:1788448423.286997:0:13732:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc1bf822c00 uarg=0000000000000000 20000000:01000000:0.0:1788448423.287038:0:13732:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788448423.287044:0:13732:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788448423.287048:0:13732:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788448423.287842:0:13733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1788448423.289076:0:13732:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788448423.295645:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788448423.297340:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788448423.297377:0:13732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788448423.297432:0:13732:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788448423.297451:0:13732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297469:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297478:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297486:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297493:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297501:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297508:0:13732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297526:0:13732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297571:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297585:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 23 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448423.297599:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324224:0@lo:104: 00000100:00100000:3.0:1788448423.297661:0:13732:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448423.297719:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297727:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 23 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448423.297735:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324352:0@lo:104: 00010000:00010000:3.0:1788448423.297762:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297769:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 23 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448423.297777:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324480:0@lo:104: 00010000:00010000:3.0:1788448423.297801:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297811:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 12 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448423.297820:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324608:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448423.297919:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297927:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 23 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448423.297935:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324736:0@lo:104: 00010000:00010000:3.0:1788448423.297963:0:13732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.297971:0:13732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 12 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448423.297979:0:13732:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324864:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448423.297999:0:13732:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448423.298205:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788448423.298225:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.298252:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.298269:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.298278:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826324224 00000100:00100000:2.0:1788448423.298283:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826324224 00000100:00100000:2.0:1788448423.298317:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826324352 00000100:00100000:2.0:1788448423.298320:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826324352 00000100:00100000:2.0:1788448423.298331:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826324480 00000100:00100000:2.0:1788448423.298334:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826324480 00000100:00100000:2.0:1788448423.298343:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826324736 00000100:00100000:2.0:1788448423.298345:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826324736 00000100:00100000:2.0:1788448423.298357:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448423.298366:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba294c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:13732:x1875323826324224:12345-0@lo:104: 00010000:00010000:2.0:1788448423.298378:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298452:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448423.298458:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba294c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+6:13732:x1875323826324224:12345-0@lo:104: Request processed in 93us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.298464:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448423.298498:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448423.298504:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:13732:x1875323826324352:12345-0@lo:104: 00010000:00010000:2.0:1788448423.298512:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298560:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448423.298565:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+5:13732:x1875323826324352:12345-0@lo:104: Request processed in 62us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.298572:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448423.298585:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448423.298591:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:13732:x1875323826324480:12345-0@lo:104: 00010000:00010000:2.0:1788448423.298599:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298631:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788448423.298636:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+4:13732:x1875323826324480:12345-0@lo:104: Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.298642:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448423.298654:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448423.298660:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:13732:x1875323826324736:12345-0@lo:104: 00010000:00010000:2.0:1788448423.298667:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298698:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788448423.298704:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+3:13732:x1875323826324736:12345-0@lo:104: Request processed in 45us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.298710:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788448423.298730:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448423.298736:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298743:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448423.298753:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298761:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448423.298768:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448423.298773:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448423.298801:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298807:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448423.298825:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298832:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181681800/0xf45a9e4e6b803851 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803858 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298846:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448423.298849:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298855:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448423.298858:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298864:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448423.298901:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448423.298907:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448423.298922:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298927:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448423.298942:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298947:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180030400/0xf45a9e4e6b803843 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80384a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298957:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448423.298960:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298965:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448423.298968:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.298974:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448423.298979:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448423.298984:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448423.299004:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299009:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448423.299015:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299021:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b803835 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b80383c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299029:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448423.299032:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299038:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181680200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448423.299040:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299047:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448423.299053:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448423.299058:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788448423.299070:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299075:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448423.299081:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299647:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181680200/0xf45a9e4e6b803820 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b803827 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.299667:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.299668:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.299670:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.299678:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.299685:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.299690:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448423.299705:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826324992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448423.299752:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.300905:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448423.300920:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826325376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448423.300964:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.301049:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324224:0@lo:104: 00000100:00100000:3.0:1788448423.301060:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324352:0@lo:104: 00000100:00100000:3.0:1788448423.301068:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324480:0@lo:104: 00000100:00100000:3.0:1788448423.301076:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324736:0@lo:104: 00000100:00100000:3.0:1788448423.301312:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0823f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826325120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448423.301651:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826325248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448423.301677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448423.301718:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826324992 00000100:00100000:0.0:1788448423.301725:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826324992 00010000:00010000:0.0:1788448423.301758:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 24 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448423.301783:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325376 00000100:00100000:0.0:1788448423.301787:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325376 00010000:00010000:0.0:1788448423.301798:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 25 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448423.301816:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788448423.301825:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+25:3648:x1875323826324992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448423.301837:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448423.301843:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 25 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.301854:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 25 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.301870:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b803858 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803851 expref: 25 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.301903:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448423.301937:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826324992:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (2185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448423.301957:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788448423.301975:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788448423.301982:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3648:x1875323826325376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448423.301990:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448423.301995:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 23 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.302003:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 23 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.302014:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b803827 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803820 expref: 23 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.302024:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448423.302048:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3648:x1875323826325376:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448423.302053:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00080000:0.0:1788448423.303166:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1788448423.303193:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1788448423.303203:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788448423.303230:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303240:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303247:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303273:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448423.303278:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303286:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303298:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9fc1a0b31500) 00010000:00010000:0.0:1788448423.303301:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448423.303305:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303310:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8038e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303326:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303332:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303337:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303342:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448423.303344:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303350:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303368:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9fc1a0b31700) 00010000:00010000:0.0:1788448423.303371:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448423.303374:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303379:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b8038f9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303417:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303423:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303429:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303434:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448423.303437:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303444:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303452:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x4c7f1faf (ffff9fc1a0b31500) 00010000:00010000:0.0:1788448423.303455:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448423.303458:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303463:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803962 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x4c7f1faf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303489:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303496:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303502:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303703:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448423.303707:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303713:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303722:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9fc1a0b31600) 00010000:00010000:0.0:1788448423.303724:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448423.303727:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.303733:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b80397e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448423.304165:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325248 00000100:00100000:0.0:1788448423.304173:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325248 00010000:00010000:0.0:1788448423.304201:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 22 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448423.304229:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788448423.304236:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3646:x1875323826325248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448423.304257:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448423.305861:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 22 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.305876:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 22 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.305912:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181680000/0xf45a9e4e6b80383c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803835 expref: 22 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.305927:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448423.305998:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3646:x1875323826325248:12345-0@lo:103:ldlm_bl.0 Request processed in 1761us (4319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448423.306007:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448423.306139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.306338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826325248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448423.306368:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826325376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448423.306378:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826324992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448423.306910:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325120 00000100:00100000:3.0:1788448423.306917:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325120 00010000:00010000:3.0:1788448423.306947:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 21 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448423.307054:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788448423.307065:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3645:x1875323826325120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448423.307078:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448423.307083:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 21 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448423.307291:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448423.307305:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826325504:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788448423.307351:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.307405:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325504 00000100:00100000:2.0:1788448423.307417:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325504 00000100:00100000:2.0:1788448423.307462:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448423.307469:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826325504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788448423.307490:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:2.0:1788448423.307537:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a998ea1, atime: 0x6a998ea1, ctime: 0x6a998ea1, blocks: 0x0 00010000:00010000:2.0:1788448423.307545:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307559:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788448423.307563:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448423.307570:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307587:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307597:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307604:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307621:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788448423.307751:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826325504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 282us (399us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788448423.307758:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788448423.307778:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788448423.307811:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc1bb796a00/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788448423.307817:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826325504:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788448423.307829:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448423.307835:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307843:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448423.307847:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307857:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307871:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307877:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000646f40f8/0xf45a9e4e6b803993 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448423.307916:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.307918:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.307920:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448423.310001:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 21 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.310021:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351e000/0xf45a9e4e6b80384a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b803843 expref: 21 pid: 6511 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.310037:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448423.310122:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3645:x1875323826325120:12345-0@lo:103:ldlm_bl.0 Request processed in 3057us (3981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.310147:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448423.311018:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0823f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826325120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448423.312154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448423.312224:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324608:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448423.312234:0:13732:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13732:1875323826324864:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448423.312282:0:13732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448423.315102:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.320827:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070208 00000100:00100000:1.0:1788448423.320841:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070208 00010000:00010000:1.0:1788448423.320900:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 13 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448423.320926:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1788448423.320935:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801070208:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448423.320948:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448423.320953:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 13 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448423.321042:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070080 00000100:00100000:0.0:1788448423.321046:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070080 00010000:00010000:0.0:1788448423.321063:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 14 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448423.321079:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:0.0:1788448423.321085:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+14:2399:x1875323801070080:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448423.321092:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448423.321097:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 14 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321117:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 13 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.321202:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 14 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.321220:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681a00/0xf45a9e4e6b80382e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0552 expref: 14 pid: 6509 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448423.321252:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448423.321317:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801070080:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 231us (9170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448423.321325:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00010000:00010000:1.0:1788448423.321441:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152f600/0xf45a9e4e6b803819 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e054b expref: 12 pid: 6510 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321454:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321462:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321477:0:13187:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321494:0:13187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321501:0:13187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321508:0:13187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321514:0:13187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9c00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448423.321518:0:13187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.321526:0:13187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.321634:0:13732:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448423.321654:0:13732:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.323183:0:13187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.323199:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9c00/0xf45a9e4e6b80398c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448423.323217:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448423.323311:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2399:x1875323801070208:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2373us (8215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.323319:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:3.0:1788448423.614592:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826325760:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614658:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614714:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826326272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614765:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826326784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614817:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788448423.614823:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826325632:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614845:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614861:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826326144:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614902:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614918:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826326656:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614965:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826325888:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.614986:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.614995:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826326400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615013:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.615025:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615041:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.615057:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788448423.615063:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826326016:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615092:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.615107:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826326528:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615124:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.615148:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325760 00000100:00100000:3.0:1788448423.615155:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325760 00000100:00100000:3.0:1788448423.615186:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326016 00000100:00100000:3.0:1788448423.615189:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326016 00000100:00100000:3.0:1788448423.615203:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788448423.615210:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826325760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615256:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826325760:12345-0@lo:400:kworker.0 Request processed in 46us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615264:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788448423.615278:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788448423.615284:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826326016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615313:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826326016:12345-0@lo:400:kworker.0 Request processed in 29us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615319:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788448423.615335:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326272 00000100:00100000:3.0:1788448423.615339:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326272 00000100:00100000:3.0:1788448423.615365:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325632 00000100:00100000:3.0:1788448423.615368:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325632 00000100:00100000:3.0:1788448423.615377:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326144 00000100:00100000:3.0:1788448423.615379:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326144 00000100:00100000:3.0:1788448423.615409:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326656 00000100:00100000:3.0:1788448423.615412:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326656 00000100:00100000:3.0:1788448423.615425:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826325888 00000100:00100000:3.0:1788448423.615427:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826325888 00000100:00100000:3.0:1788448423.615437:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326528 00000100:00100000:3.0:1788448423.615439:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326528 00000100:00100000:3.0:1788448423.615463:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788448423.615470:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826326272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615501:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826326272:12345-0@lo:400:kworker.0 Request processed in 32us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615507:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788448423.615521:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788448423.615526:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826325632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615552:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826325632:12345-0@lo:400:kworker.0 Request processed in 27us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615557:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788448423.615568:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788448423.615574:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826326144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615600:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826326144:12345-0@lo:400:kworker.0 Request processed in 27us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615606:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788448423.615617:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788448423.615623:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826326656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615647:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826326656:12345-0@lo:400:kworker.0 Request processed in 26us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615652:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788448423.615663:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788448423.615667:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826325888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615692:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826325888:12345-0@lo:400:kworker.0 Request processed in 24us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615697:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788448423.615716:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788448423.615722:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826326528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615750:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826326528:12345-0@lo:400:kworker.0 Request processed in 29us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615756:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788448423.615778:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326784 00000100:00100000:3.0:1788448423.615782:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326784 00000100:00100000:3.0:1788448423.615807:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326400 00000100:00100000:3.0:1788448423.615810:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326400 00000100:00100000:3.0:1788448423.615823:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826326912 00000100:00100000:3.0:1788448423.615825:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826326912 00000100:00100000:3.0:1788448423.615837:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788448423.615843:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826326784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615873:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826326784:12345-0@lo:400:kworker.0 Request processed in 30us (1082us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615900:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788448423.615913:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788448423.615918:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826326400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615945:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826326400:12345-0@lo:400:kworker.0 Request processed in 27us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615951:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788448423.615960:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788448423.615965:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826326912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.615988:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826326912:12345-0@lo:400:kworker.0 Request processed in 23us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.615994:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788448423.616011:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448423.616020:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448423.616023:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448423.616025:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448423.616054:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826326016:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.616065:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826326528:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.616074:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826325888:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.616085:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826326400:0@lo:400:kworker.0 00010000:00080000:3.0:1788448423.616095:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0a80 x1875323826326912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448423.616106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.616153:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826325632:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.616163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826326144:0@lo:400:kworker.0 00010000:00080000:3.0:1788448423.616173:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f0700 x1875323826326656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448423.616182:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826326656:0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.616191:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826325760:0@lo:400:kworker.0 00010000:00080000:3.0:1788448423.616200:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b4380 x1875323826326272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448423.616208:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826326272:0@lo:400:kworker.0 00010000:00080000:3.0:1788448423.616217:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f2680 x1875323826326784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448423.616225:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826326784:0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.805412:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.805455:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.805489:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.805526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.805548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.805574:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448423.805610:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070592 00000100:00100000:1.0:1788448423.805620:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070592 00000100:00100000:1.0:1788448423.805668:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070848 00000100:00100000:1.0:1788448423.805672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070848 00000100:00100000:1.0:1788448423.805686:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070464 00000100:00100000:1.0:1788448423.805689:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070464 00000100:00100000:1.0:1788448423.805699:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070976 00000100:00100000:1.0:1788448423.805701:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070976 00000100:00100000:1.0:1788448423.805718:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:1.0:1788448423.805734:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801070592:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448423.805805:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801070592:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.805812:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:1.0:1788448423.805830:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:1.0:1788448423.805837:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801070848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448423.805861:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801070848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.805866:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:1.0:1788448423.805878:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 236 00000100:00100000:1.0:1788448423.805918:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801070464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448423.805942:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801070464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.805949:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 236 00000100:00100000:1.0:1788448423.805970:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:0.0:1788448423.806078:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070336 00000100:00100000:0.0:1788448423.806083:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070336 00000100:00100000:0.0:1788448423.806131:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 340 00000100:00100000:0.0:1788448423.806138:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2399:x1875323801070336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448423.806166:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2399:x1875323801070336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448423.806172:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 340 00000100:00100000:1.0:1788448423.806947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801070976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448423.808385:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb574e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801070976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2400us (2802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.808409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:1.0:1788448423.808462:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801070720 00000100:00100000:1.0:1788448423.808469:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801070720 00000100:00100000:1.0:1788448423.808517:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:1.0:1788448423.808527:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801070720:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448423.808558:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801070720:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (3010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.808564:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00080000:1.0:1788448423.808584:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448423.808588:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448423.808591:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788448423.934090:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448424.115505:0:13782:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffced1dba10 20000000:00000080:2.0:1788448424.115521:0:13782:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc0833f7c00 uarg=0000000000000000 20000000:01000000:2.0:1788448424.115561:0:13782:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788448424.115567:0:13782:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788448424.115571:0:13782:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1788448424.117561:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:3.0:1788448424.117785:0:13782:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1788448424.117864:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788448424.118171:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788448424.118192:0:13782:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788448424.118206:0:13782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788448424.118224:0:13782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118238:0:13782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118248:0:13782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118255:0:13782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118262:0:13782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118341:0:13782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118347:0:13782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448424.118351:0:13782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118371:0:13782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118383:0:13782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118401:0:13782:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.118408:0:13782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b80399a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448424.126601:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448424.126622:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826327040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448424.126683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448424.126745:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327040 00000100:00100000:2.0:1788448424.126752:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327040 00000100:00100000:2.0:1788448424.126794:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788448424.126802:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826327040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448424.126827:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448424.126866:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826327040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448424.126873:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1788448424.126933:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb796680 x1875323826327040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448424.126950:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826327040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448424.127099:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448424.127109:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826327168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448424.127138:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448424.127163:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327168 00000100:00100000:0.0:1788448424.127166:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327168 00000100:00100000:0.0:1788448424.127188:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788448424.127194:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826327168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448424.127204:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448424.127233:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826327168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448424.127239:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:0.0:1788448424.127266:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835e5c00 x1875323826327168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448424.127279:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826327168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448424.360280:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448424.365962:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071104 00000100:00100000:3.0:1788448424.366043:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071104 00000100:00100000:3.0:1788448424.366590:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 341 00000100:00100000:3.0:1788448424.366603:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:6171:x1875323801071104:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448424.366620:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448424.366639:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8039a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e059f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448424.366666:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8039a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e059f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448424.366678:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8039a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e059f expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448424.366688:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8e00, rc 0) 00000100:00100000:3.0:1788448424.366762:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801071104:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 163us (7326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448424.366771:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 341 00000100:00100000:1.0:1788448424.374615:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448424.374871:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071232 00000100:00100000:2.0:1788448424.375016:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071232 00000100:00100000:2.0:1788448424.375066:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 342 00000100:00100000:2.0:1788448424.375077:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801071232:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448424.375245:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801071232:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 167us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448424.375254:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 342 00000100:00100000:0.0:1788448424.379471:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448424.379646:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071360 00000100:00100000:3.0:1788448424.379656:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071360 00000100:00100000:3.0:1788448424.379773:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 343 00000100:00100000:3.0:1788448424.379783:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801071360:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448424.379939:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801071360:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 156us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448424.379947:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 343 00000100:00100000:3.0:1788448424.385963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448424.386012:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071488 00000100:00100000:1.0:1788448424.386023:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071488 00000100:00100000:1.0:1788448424.386079:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 344 00000100:00100000:1.0:1788448424.386089:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:10786:x1875323801071488:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448424.386235:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:10786:x1875323801071488:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 146us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448424.386244:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 344 00000100:00100000:1.0:1788448424.395598:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448424.395786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071616 00000100:00100000:3.0:1788448424.395795:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071616 00000100:00100000:3.0:1788448424.395844:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:3.0:1788448424.395854:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:10786:x1875323801071616:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448424.396151:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:10786:x1875323801071616:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 296us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448424.396161:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:0.0:1788448424.401287:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448424.401381:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071744 00000100:00100000:2.0:1788448424.401403:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071744 00000100:00100000:2.0:1788448424.401460:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 346 00000100:00100000:2.0:1788448424.401470:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:6171:x1875323801071744:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448424.401485:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448424.401502:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330600/0xf45a9e4e6b8039a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05a6 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.401537:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330600/0xf45a9e4e6b8039a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05a6 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.401552:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0330600/0xf45a9e4e6b8039a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05a6 expref: 13 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448424.401561:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330600, rc 0) 00000100:00100000:2.0:1788448424.401667:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801071744:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 197us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448424.401674:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 346 00000100:00100000:3.0:1788448424.404384:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448424.404491:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801071872 00000100:00100000:2.0:1788448424.404500:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801071872 00000100:00100000:2.0:1788448424.404722:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 347 00000100:00100000:2.0:1788448424.404735:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801071872:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448424.404971:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801071872:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 240us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448424.404979:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 347 00000100:00100000:2.0:1788448424.408983:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448424.409073:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072000 00000100:00100000:0.0:1788448424.409131:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072000 00000100:00100000:0.0:1788448424.409231:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 348 00000100:00100000:0.0:1788448424.409242:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801072000:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448424.409380:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192020850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:6171:x1875323801072000:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 139us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448424.409398:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 348 00000100:00100000:0.0:1788448424.415363:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448424.415458:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072128 00000100:00100000:2.0:1788448424.415467:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072128 00000100:00100000:2.0:1788448424.415522:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 349 00000100:00100000:2.0:1788448424.415533:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:10789:x1875323801072128:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448424.415675:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:10789:x1875323801072128:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 143us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448424.415685:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 349 00000100:00100000:3.0:1788448424.417608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448424.417699:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072256 00000100:00100000:0.0:1788448424.417708:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072256 00000100:00100000:0.0:1788448424.417755:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 350 00000100:00100000:0.0:1788448424.417764:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:10789:x1875323801072256:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448424.417921:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:10789:x1875323801072256:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 158us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448424.417929:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 350 00000100:00100000:1.0:1788448424.638188:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448424.638221:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826327296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448424.638319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448424.638648:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327296 00000100:00100000:3.0:1788448424.638658:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327296 00000100:00100000:3.0:1788448424.638714:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788448424.638724:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826327296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448424.638758:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788448424.638816:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826327296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448424.638823:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788448424.639085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826327296:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448424.958904:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788448425.022178:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788448425.022314:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bf749000 from 7 10000000:01000000:0.0:1788448425.022319:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448425.022380:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448425.022403:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448425.022434:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448425.022457:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826327424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448425.022530:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448425.022678:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448425.022757:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327424 00000100:00100000:1.0:1788448425.022764:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327424 00000100:00100000:1.0:1788448425.029672:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788448425.029693:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:6514:x1875323826327424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448425.029710:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448425.029730:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc180031800/0xf45a9e4e6b8039b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8039af expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448425.029761:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc180031800/0xf45a9e4e6b8039b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039af expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448425.029771:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc180031800/0xf45a9e4e6b8039b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039af expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448425.029780:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031800, rc 0) 00000100:00100000:1.0:1788448425.030054:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192022850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826327424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 370us (7522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448425.030061:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788448425.035488:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826327424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448425.035516:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448425.035529:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448425.035615:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826327552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448425.035668:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448425.035722:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448425.035820:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327552 00000100:00100000:0.0:1788448425.035827:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327552 00000100:00100000:0.0:1788448425.035875:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788448425.035907:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826327552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448425.036033:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826327552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 128us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448425.036041:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788448425.036222:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826327552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448425.036255:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826327680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448425.036300:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448425.036327:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823ae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448425.038341:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327680 00000100:00100000:0.0:1788448425.038352:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327680 00000100:00100000:0.0:1788448425.038420:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788448425.038430:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826327680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448425.038567:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826327680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (2267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448425.038575:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788448425.038609:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826327680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448425.039010:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13795:1875323826327808:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448425.039051:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448425.039086:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448425.039140:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327808 00000100:00100000:2.0:1788448425.039145:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327808 00000100:00100000:2.0:1788448425.039177:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788448425.039198:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:13795:x1875323826327808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448425.039285:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:13795:x1875323826327808:12345-0@lo:502:llog_process_th.0 Request processed in 100us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448425.039292:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788448425.039524:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13795:1875323826327808:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448425.039545:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448425.039558:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448425.039560:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448425.039566:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1bf749000 00000020:00000080:0.0:1788448425.039568:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448425.039622:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448425.039625:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448425.039626:0:13795:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448425.039629:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448425.039631:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448425.039632:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788448425.039635:0:13795:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1bf749000 00000020:00000080:0.0:1788448425.039637:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448425.039666:0:13795:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13795:1875323826327936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448425.039696:0:13795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448425.039722:0:13795:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.039776:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826327936 00000100:00100000:3.0:1788448425.039781:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826327936 00000100:00100000:3.0:1788448425.039810:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788448425.039817:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:13795:x1875323826327936:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.039909:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:13795:x1875323826327936:12345-0@lo:502:llog_process_th.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.039916:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788448425.039994:0:13795:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13795:1875323826327936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448425.040012:0:13795:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448425.040017:0:13795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448425.040018:0:13795:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788448425.040021:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788448425.040170:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788448425.040223:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448425.040233:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.040255:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448425.040265:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448425.040268:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1ba23b000 from 7 10000000:01000000:3.0:1788448425.040271:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448425.040298:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.040306:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.040316:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448425.040329:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.040358:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.040402:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448425.040955:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328064 00000100:00100000:0.0:1788448425.040961:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328064 00000100:00100000:0.0:1788448425.040993:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1788448425.041012:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:6514:x1875323826328064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448425.041023:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448425.041035:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b8039c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8039bd expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448425.041057:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b8039c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039bd expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448425.041082:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b8039c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039bd expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448425.041090:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e600, rc 0) 00000100:00100000:0.0:1788448425.041128:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826328064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448425.041134:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788448425.041229:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448425.041243:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.041252:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448425.041303:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.041331:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.041367:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448425.041495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328192 00000100:00100000:0.0:1788448425.041499:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328192 00000100:00100000:0.0:1788448425.041531:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1788448425.041537:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826328192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448425.041626:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826328192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448425.041634:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788448425.045464:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.045530:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.045603:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.045638:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.045657:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328320 00000100:00100000:3.0:1788448425.045662:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328320 00000100:00100000:3.0:1788448425.045703:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788448425.045712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826328320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.045826:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826328320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.045834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788448425.045878:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.046076:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13796:1875323826328448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.046110:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.046128:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328448 00000100:00100000:3.0:1788448425.046132:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328448 00000100:00100000:3.0:1788448425.046148:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788448425.046154:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:13796:x1875323826328448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.047409:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:13796:x1875323826328448:12345-0@lo:502:llog_process_th.0 Request processed in 1249us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.047419:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788448425.047473:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.047491:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13796:1875323826328448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448425.047519:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448425.047532:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.047534:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448425.047549:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1ba23b000 00000020:00000080:3.0:1788448425.047552:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448425.047587:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448425.047590:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.047591:0:13796:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448425.047594:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448425.047596:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.047598:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788448425.047601:0:13796:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1ba23b000 00000020:00000080:3.0:1788448425.047603:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448425.047637:0:13796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13796:1875323826328576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.047675:0:13796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.047694:0:13796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788448425.048299:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328576 00000100:00100000:1.0:1788448425.048307:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328576 00000100:00100000:1.0:1788448425.048353:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788448425.048368:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:13796:x1875323826328576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448425.048466:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:13796:x1875323826328576:12345-0@lo:502:llog_process_th.0 Request processed in 100us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448425.048473:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788448425.049093:0:13796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13796:1875323826328576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448425.049120:0:13796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448425.049126:0:13796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.049128:0:13796:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788448425.049139:0:13796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788448425.051507:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788448425.051540:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448425.051551:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448425.051563:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448425.051574:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448425.051576:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc19ea22000 from 7 10000000:01000000:1.0:1788448425.051580:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448425.051616:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448425.051624:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448425.051635:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448425.051657:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448425.051718:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448425.051763:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823aecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.052013:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328704 00000100:00100000:3.0:1788448425.052021:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328704 00000100:00100000:3.0:1788448425.052070:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788448425.052080:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:6514:x1875323826328704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448425.052093:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448425.052104:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8039d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8039cb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.052127:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8039d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039cb expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.052155:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8039d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039cb expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.052165:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8000, rc 0) 00000100:00100000:3.0:1788448425.052228:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826328704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.052235:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788448425.053711:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448425.053736:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448425.053749:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448425.053830:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448425.053910:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448425.053934:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.054019:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328832 00000100:00100000:3.0:1788448425.054024:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328832 00000100:00100000:3.0:1788448425.054069:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788448425.054078:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826328832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.054211:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826328832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 135us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.054219:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788448425.054290:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb797100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448425.054321:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448425.054394:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448425.054417:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823ae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.054542:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826328960 00000100:00100000:3.0:1788448425.054547:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826328960 00000100:00100000:3.0:1788448425.054580:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788448425.054587:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826328960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.054664:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826328960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.054671:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788448425.054745:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826328960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.058297:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13798:1875323826329088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.058382:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.058435:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329088 00000100:00100000:3.0:1788448425.058442:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329088 00000100:00100000:3.0:1788448425.058492:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788448425.058501:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:13798:x1875323826329088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.058618:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:13798:x1875323826329088:12345-0@lo:502:llog_process_th.0 Request processed in 117us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.058626:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788448425.058674:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc181377c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.058692:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13798:1875323826329088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448425.058715:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448425.058723:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.058725:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448425.058740:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc19ea22000 00000020:00000080:3.0:1788448425.058743:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448425.058788:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448425.058791:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.058793:0:13798:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448425.058797:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448425.058799:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.058800:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788448425.058804:0:13798:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc19ea22000 00000020:00000080:3.0:1788448425.058805:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448425.058835:0:13798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13798:1875323826329216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.058870:0:13798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.058907:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329216 00000100:00100000:3.0:1788448425.058911:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329216 00000100:00100000:3.0:1788448425.058933:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788448425.058938:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:13798:x1875323826329216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.058999:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:13798:x1875323826329216:12345-0@lo:502:llog_process_th.0 Request processed in 59us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.059014:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788448425.059043:0:13798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908606c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.059055:0:13798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13798:1875323826329216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448425.059074:0:13798:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448425.059078:0:13798:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448425.059080:0:13798:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788448425.059086:0:13798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788448425.060085:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788448425.060129:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448425.060139:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448425.060151:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448425.060163:0:6514:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448425.060171:0:6514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc190ac6000 from 7 10000000:01000000:2.0:1788448425.060174:0:6514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448425.060217:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448425.060227:0:6514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448425.060237:0:6514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448425.060253:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826329344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448425.060295:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448425.060319:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.060828:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329344 00000100:00100000:3.0:1788448425.060835:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329344 00000100:00100000:3.0:1788448425.060901:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788448425.060911:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:6514:x1875323826329344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448425.060924:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448425.060937:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8039e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8039d9 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.060959:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8039e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039d9 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.060969:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8039e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8039d9 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.060978:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a8200, rc 0) 00000100:00100000:3.0:1788448425.061023:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826329344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.061029:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788448425.061073:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826329344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448425.061086:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448425.061102:0:6514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448425.061152:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826329472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.061177:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.061310:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.061324:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329472 00000100:00100000:3.0:1788448425.061327:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329472 00000100:00100000:3.0:1788448425.061441:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788448425.061451:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826329472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.061551:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826329472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.061558:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788448425.061588:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826329472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.061613:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826329600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.061650:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448425.061662:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.061673:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329600 00000100:00100000:3.0:1788448425.061676:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329600 00000100:00100000:3.0:1788448425.061695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788448425.061700:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826329600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448425.061765:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:6514:x1875323826329600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 64us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.061772:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788448425.061815:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:6514:1875323826329600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448425.068225:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13800:1875323826329728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448425.068316:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448425.068367:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448425.068914:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329728 00000100:00100000:3.0:1788448425.068921:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329728 00000100:00100000:3.0:1788448425.068969:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1788448425.068978:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:13800:x1875323826329728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448425.069102:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:13800:x1875323826329728:12345-0@lo:502:llog_process_th.0 Request processed in 123us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448425.069109:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1788448425.069554:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13800:1875323826329728:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448425.069585:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448425.069594:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448425.069597:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788448425.069606:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc190ac6000 00000020:00000080:2.0:1788448425.069609:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448425.069667:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448425.069671:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448425.069672:0:13800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788448425.069675:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448425.069677:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448425.069678:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788448425.069682:0:13800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc190ac6000 00000020:00000080:2.0:1788448425.069691:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788448425.069729:0:13800:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13800:1875323826329856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448425.069769:0:13800:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448425.069810:0:13800:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824200c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448425.069932:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329856 00000100:00100000:0.0:1788448425.069937:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329856 00000100:00100000:0.0:1788448425.069981:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788448425.069989:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:13800:x1875323826329856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448425.070073:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:13800:x1875323826329856:12345-0@lo:502:llog_process_th.0 Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448425.070080:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1788448425.070109:0:13800:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:13800:1875323826329856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448425.070128:0:13800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448425.070132:0:13800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448425.070134:0:13800:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788448425.070138:0:13800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788448425.070353:0:6514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788448425.070393:0:6514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448425.070403:0:6514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448425.070426:0:6514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448425.076942:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788448425.093015:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788448425.987452:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448426.111477:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788448426.111988:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448426.686415:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826329984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448426.686481:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448426.686620:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826329984 00000100:00100000:3.0:1788448426.686630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826329984 00000100:00100000:3.0:1788448426.686684:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788448426.686694:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826329984:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448426.686730:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448426.686778:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826329984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448426.686785:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788448426.686966:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a6bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826329984:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448426.687674:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448426.687686:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826330112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448426.687844:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448426.688010:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448426.688021:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826330240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448426.690945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448426.706931:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330112 00000100:00100000:2.0:1788448426.706946:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330112 00000100:00100000:3.0:1788448426.708967:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330240 00000100:00100000:3.0:1788448426.708978:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330240 00000100:00100000:3.0:1788448426.709001:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788448426.709011:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826330112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448426.709039:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448426.709120:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826330112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (21276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448426.709128:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788448426.709158:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788448426.709164:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826330240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448426.709174:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788448426.709415:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448426.709475:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826330112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448426.709811:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826330240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 645us (18873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448426.709818:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788448426.709925:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826330240:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788448427.010828:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448428.030789:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448428.734681:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826330752:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.734777:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.734837:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826331264:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.734861:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.734876:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826331776:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.734913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.734937:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788448428.734942:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826330368:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.734964:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.734980:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826330880:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.734998:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.735011:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826331392:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.735027:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.735038:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826331904:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.735053:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.735076:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330880 00000100:00100000:3.0:1788448428.735082:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330880 00000100:00100000:3.0:1788448428.735117:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788448428.735125:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826330880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.735177:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826330880:12345-0@lo:400:kworker.0 Request processed in 52us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448428.735185:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788448428.735231:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826330880:0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.738552:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330752 00000100:00100000:0.0:1788448428.738567:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330752 00000100:00100000:0.0:1788448428.738639:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788448428.738650:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826330752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.738758:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826330752:12345-0@lo:400:kworker.0 Request processed in 110us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.738765:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788448428.738793:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331264 00000100:00100000:0.0:1788448428.738797:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331264 00000100:00100000:0.0:1788448428.738823:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331776 00000100:00100000:0.0:1788448428.738827:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331776 00000100:00100000:0.0:1788448428.738843:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331392 00000100:00100000:0.0:1788448428.738846:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331392 00000100:00100000:0.0:1788448428.738858:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331904 00000100:00100000:0.0:1788448428.738861:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331904 00000100:00100000:0.0:1788448428.738874:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448428.738917:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826331264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.738970:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826331264:12345-0@lo:400:kworker.0 Request processed in 89us (4107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.738977:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448428.738991:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448428.738998:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826331776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.739028:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826331776:12345-0@lo:400:kworker.0 Request processed in 32us (4115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.739035:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448428.739047:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448428.739054:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826331392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.739081:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826331392:12345-0@lo:400:kworker.0 Request processed in 29us (4052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.739087:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448428.739098:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448428.739103:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826331904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.739127:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826331904:12345-0@lo:400:kworker.0 Request processed in 24us (4073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.739132:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788448428.739349:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330368 00000100:00100000:2.0:1788448428.739355:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330368 00000100:00100000:2.0:1788448428.739400:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788448428.739409:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826330368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.739461:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826330368:12345-0@lo:400:kworker.0 Request processed in 53us (4495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.739468:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1788448428.739511:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826330496:0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.739551:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448428.739576:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826331008:0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.739598:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448428.739625:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826331520:0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.739649:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448428.739672:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788448428.739679:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826330624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.739791:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448428.739811:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826331136:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.739832:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330496 00000100:00100000:2.0:1788448428.739833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.739840:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330496 00000100:00100000:2.0:1788448428.739849:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826331648:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.739866:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331008 00000100:00100000:3.0:1788448428.739870:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331008 00000100:00100000:2.0:1788448428.739874:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448428.739912:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331520 00000100:00100000:3.0:1788448428.739916:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331520 00000100:00100000:2.0:1788448428.739922:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331136 00000100:00100000:2.0:1788448428.739928:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331136 00000100:00100000:3.0:1788448428.739933:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826331648 00000100:00100000:3.0:1788448428.739938:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826331648 00000100:00100000:2.0:1788448428.739959:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788448428.739966:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788448428.739971:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826330496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.739979:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826331008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.740187:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788448428.740197:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788448428.740213:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788448428.740221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788448428.740233:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826331520:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788448428.741027:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448428.741033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448428.741036:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448428.741038:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448428.741259:0:13810:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:0.0:1788448428.741271:0:13810:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_005' 00000100:00100000:0.0:1788448428.741380:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788448428.741391:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826331136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.741589:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826330496:12345-0@lo:400:kworker.0 Request processed in 1621us (2036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.741596:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788448428.741615:0:9023:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 5 min 3 max 116 00000100:00100000:2.0:1788448428.741622:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788448428.741628:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826331648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.741660:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826331648:12345-0@lo:400:kworker.0 Request processed in 33us (1787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.741666:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788448428.741688:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826330624 00000100:00100000:2.0:1788448428.741694:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826330624 00000100:00100000:2.0:1788448428.741721:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788448428.741727:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826330624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.741914:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826331008:12345-0@lo:400:kworker.0 Request processed in 1937us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448428.741921:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788448428.742073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826330368:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.742091:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826331392:0@lo:400:kworker.0 00010000:00080000:3.0:1788448428.742106:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d1880 x1875323826331904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448428.742117:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826331904:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.742129:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826330752:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.742141:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826331264:0@lo:400:kworker.0 00010000:00080000:3.0:1788448428.742153:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d3100 x1875323826331776/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448428.742170:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826331776:0@lo:400:kworker.0 00010000:00080000:3.0:1788448428.742223:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d2680 x1875323826331648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448428.742233:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826331648:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.742244:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826330496:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.742255:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826331008:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.742661:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826331520:12345-0@lo:400:kworker.0 Request processed in 2431us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448428.742670:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788448428.745851:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826331136:12345-0@lo:400:kworker.0 Request processed in 4455us (6009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.745865:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00010000:00080000:3.0:1788448428.746356:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d0e00 x1875323826331136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448428.746382:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826331136:0@lo:400:kworker.0 00000100:00100000:3.0:1788448428.746399:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826331520:0@lo:400:kworker.0 00000100:00100000:2.0:1788448428.747195:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826330624:12345-0@lo:400:kworker.0 Request processed in 5465us (7400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.747206:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000001:00080000:2.0:1788448428.747953:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788448428.749022:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826330624:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.902103:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448428.902152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448428.902739:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072384 00000100:00100000:0.0:1788448428.902752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072384 00000100:00100000:0.0:1788448428.902817:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 372 00000100:00100000:0.0:1788448428.902827:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801072384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448428.902937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801072384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 111us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.902945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 372 00000100:00100000:1.0:1788448428.903157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448428.903254:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448428.903281:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072640 00000100:00100000:1.0:1788448428.903286:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072640 00000100:00100000:1.0:1788448428.903328:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072896 00000100:00100000:1.0:1788448428.903331:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072896 00000100:00100000:1.0:1788448428.903350:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072512 00000100:00100000:1.0:1788448428.903354:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072512 00000100:00100000:1.0:1788448428.903404:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:1.0:1788448428.903411:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801072640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448428.903449:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801072640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448428.903456:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:2.0:1788448428.903622:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:2.0:1788448428.903633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801072896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448428.903665:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801072896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.903671:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:2.0:1788448428.903685:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 246 00000100:00100000:2.0:1788448428.903691:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801072512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448428.903714:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801072512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.903719:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 246 00000100:00080000:2.0:1788448428.903751:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448428.903755:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448428.910556:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448428.910635:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448428.910783:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073024 00000100:00100000:3.0:1788448428.910794:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073024 00000100:00100000:3.0:1788448428.910866:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00080000:0.0:1788448428.910868:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448428.910876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801073024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448428.910973:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801073024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448428.910981:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:2.0:1788448428.913694:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801072768 00000100:00100000:2.0:1788448428.913710:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801072768 00000100:00100000:2.0:1788448428.913817:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:2.0:1788448428.913828:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801072768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448428.913943:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801072768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 117us (3396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448428.913951:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00080000:0.0:1788448428.915865:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448429.054095:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448429.246121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826332032:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448429.246190:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448429.246342:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332032 00000100:00100000:2.0:1788448429.246370:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332032 00000100:00100000:1.0:1788448429.246415:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826332160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448429.246420:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788448429.246429:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826332032:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448429.246446:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1788448429.246456:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448429.246546:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826332032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 117us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448429.246554:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:1.0:1788448429.247320:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc19137ce00 x1875323826332032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448429.247338:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826332032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448429.247404:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332160 00000100:00100000:2.0:1788448429.247409:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332160 00000100:00100000:2.0:1788448429.247432:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788448429.247439:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826332160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448429.247453:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448429.247495:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826332160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448429.247501:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00010000:00080000:1.0:1788448429.247521:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d3b80 x1875323826332160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448429.247535:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826332160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448429.761774:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826332288:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448429.761840:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448429.761981:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332288 00000100:00100000:0.0:1788448429.761989:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332288 00000100:00100000:0.0:1788448429.762041:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788448429.762051:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826332288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448429.762082:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788448429.762144:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826332288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448429.762150:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788448429.762446:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826332288:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448430.079140:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448431.102104:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448431.806136:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448431.806158:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826332416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448431.806232:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448431.806316:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332416 00000100:00100000:3.0:1788448431.806337:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332416 00000100:00100000:3.0:1788448431.806469:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788448431.806482:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826332416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448431.806508:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448431.806562:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826332416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448431.806570:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788448431.806626:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826332416:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788448431.806634:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448431.806651:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826332672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448431.806660:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826332544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448431.806691:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448431.806702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448431.806832:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332672 00000100:00100000:1.0:1788448431.806842:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332672 00000100:00100000:1.0:1788448431.806867:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788448431.806873:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826332672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448431.806908:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788448431.806940:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826332672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448431.806946:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788448431.806972:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826332672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448431.813580:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332544 00000100:00100000:2.0:1788448431.813600:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332544 00000100:00100000:2.0:1788448431.813685:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788448431.813696:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826332544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448431.813725:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448431.813820:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826332544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (7118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448431.813827:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:1.0:1788448431.813965:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448431.814140:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788448431.814147:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc1bb796a00, transno 4294967301 00000100:00100000:1.0:1788448431.814172:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826332544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448432.126630:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448433.151572:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448433.856058:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826333056:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856133:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.856191:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826333568:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856218:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.856243:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826334080:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856265:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.856293:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788448433.856299:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826333184:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856321:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.856346:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826333696:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856371:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.856386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826334208:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856405:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.856455:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333056 00000100:00100000:1.0:1788448433.856462:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333056 00000100:00100000:1.0:1788448433.856505:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788448433.856514:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826333056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856564:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826333056:12345-0@lo:400:kworker.0 Request processed in 51us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.856572:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788448433.856594:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333568 00000100:00100000:1.0:1788448433.856598:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333568 00000100:00100000:1.0:1788448433.856630:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334080 00000100:00100000:1.0:1788448433.856633:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334080 00000100:00100000:1.0:1788448433.856650:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333184 00000100:00100000:1.0:1788448433.856653:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333184 00000100:00100000:1.0:1788448433.856670:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788448433.856676:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826333568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856707:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826333568:12345-0@lo:400:kworker.0 Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.856712:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788448433.856722:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788448433.856740:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826334080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856763:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826334080:12345-0@lo:400:kworker.0 Request processed in 35us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.856768:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788448433.856780:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788448433.856785:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826333184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.856804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826333184:12345-0@lo:400:kworker.0 Request processed in 19us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.856818:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788448433.856834:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333696 00000100:00100000:1.0:1788448433.856837:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333696 00000100:00100000:1.0:1788448433.856857:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334208 00000100:00100000:1.0:1788448433.856860:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334208 00000100:00100000:1.0:1788448433.856875:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788448433.856909:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826333696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826332928:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857153:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857172:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826333440:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857199:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826333952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857215:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857232:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788448433.857237:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826332800:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857257:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857276:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826333312:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857294:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857307:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826333824:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857325:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857334:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826334336:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857366:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448433.857389:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333824 00000100:00100000:2.0:1788448433.857393:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333824 00000100:00100000:2.0:1788448433.857412:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334336 00000100:00100000:2.0:1788448433.857415:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334336 00000100:00100000:2.0:1788448433.857429:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788448433.857434:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826334208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857465:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826334208:12345-0@lo:400:kworker.0 Request processed in 30us (1060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.857472:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788448433.857484:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788448433.857490:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826333824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857532:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826333824:12345-0@lo:400:kworker.0 Request processed in 42us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.857539:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788448433.857551:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448433.857557:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826334336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857584:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826334336:12345-0@lo:400:kworker.0 Request processed in 28us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.857590:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448433.857609:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332800 00000100:00100000:2.0:1788448433.857612:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332800 00000100:00100000:2.0:1788448433.857636:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788448433.857642:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826332800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857669:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826332800:12345-0@lo:400:kworker.0 Request processed in 27us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.857675:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788448433.857700:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333312 00000100:00100000:2.0:1788448433.857704:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333312 00000100:00100000:2.0:1788448433.857719:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788448433.857725:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826333312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857751:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb427b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826333312:12345-0@lo:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.857757:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788448433.857772:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826332928 00000100:00100000:2.0:1788448433.857775:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826332928 00000100:00100000:2.0:1788448433.857789:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333440 00000100:00100000:2.0:1788448433.857791:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333440 00000100:00100000:2.0:1788448433.857801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826333952 00000100:00100000:2.0:1788448433.857810:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826333952 00000100:00100000:2.0:1788448433.857826:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788448433.857831:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826332928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.857862:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826332928:12345-0@lo:400:kworker.0 Request processed in 29us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.857867:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788448433.857878:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788448433.857916:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826333440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448433.858081:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788448433.858091:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826333952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.858210:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826333184:0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.858222:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826333696:0@lo:400:kworker.0 00010000:00080000:0.0:1788448433.858234:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf780000 x1875323826334208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448433.858245:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826334208:0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.858255:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826333056:0@lo:400:kworker.0 00010000:00080000:0.0:1788448433.858264:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf781180 x1875323826333568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448433.858271:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826333568:0@lo:400:kworker.0 00010000:00080000:0.0:1788448433.858280:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf780380 x1875323826334080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448433.858286:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826334080:0@lo:400:kworker.0 00000100:00080000:0.0:1788448433.858332:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448433.858351:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448433.858354:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448433.858356:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448433.858402:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826332800:0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.858413:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826333312:0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.858422:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826333824:0@lo:400:kworker.0 00010000:00080000:0.0:1788448433.858431:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf781c00 x1875323826334336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448433.858438:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826334336:0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.858458:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826332928:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.859263:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826333696:12345-0@lo:400:kworker.0 Request processed in 2376us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.859274:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448433.859430:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826333952:12345-0@lo:400:kworker.0 Request processed in 1341us (2212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448433.859439:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788448433.861094:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826333952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.861209:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826333440:12345-0@lo:400:kworker.0 Request processed in 3291us (4015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448433.861218:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788448433.861388:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826333440:0@lo:400:kworker.0 00000100:00100000:3.0:1788448434.022235:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448434.022281:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448434.022319:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448434.022357:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448434.022379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448434.022400:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448434.022428:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073408 00000100:00100000:3.0:1788448434.022437:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073408 00000100:00100000:3.0:1788448434.022486:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073664 00000100:00100000:3.0:1788448434.022490:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073664 00000100:00100000:3.0:1788448434.022509:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073280 00000100:00100000:3.0:1788448434.022512:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073280 00000100:00100000:3.0:1788448434.022525:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073792 00000100:00100000:3.0:1788448434.022527:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073792 00000100:00100000:3.0:1788448434.022543:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:3.0:1788448434.022552:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801073408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448434.022645:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801073408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448434.022654:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:3.0:1788448434.022673:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:3.0:1788448434.022680:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801073664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448434.022705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801073664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448434.022711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:3.0:1788448434.022725:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 256 00000100:00100000:3.0:1788448434.022837:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801073280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448434.022863:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801073280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448434.022870:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 256 00000100:00100000:3.0:1788448434.022924:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00100000:3.0:1788448434.022933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801073792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448434.022957:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801073792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448434.022964:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00080000:3.0:1788448434.022984:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448434.022988:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448434.023162:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073152 00000100:00100000:2.0:1788448434.023167:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073152 00000100:00100000:2.0:1788448434.023205:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 374 00000100:00100000:2.0:1788448434.023213:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801073152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448434.023250:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801073152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448434.023256:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 374 00000100:00100000:2.0:1788448434.023282:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073536 00000100:00100000:2.0:1788448434.023286:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073536 00000100:00100000:2.0:1788448434.023317:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:2.0:1788448434.023323:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801073536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448434.023359:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801073536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448434.023366:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00080000:3.0:1788448434.023563:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448434.174913:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448434.368767:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448434.368789:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826334464:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448434.368851:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448434.368934:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334464 00000100:00100000:1.0:1788448434.368942:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334464 00000100:00100000:1.0:1788448434.368987:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788448434.368996:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826334464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448434.369022:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448434.369065:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826334464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448434.369073:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00010000:00080000:1.0:1788448434.369123:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08373e300 x1875323826334464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448434.369140:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826334464:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448434.370693:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826334592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448434.370756:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448434.370815:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334592 00000100:00100000:3.0:1788448434.370833:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334592 00000100:00100000:3.0:1788448434.370873:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788448434.370906:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826334592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448434.370923:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448434.370960:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826334592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448434.370965:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:3.0:1788448434.370995:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf783480 x1875323826334592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448434.371009:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826334592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448434.879356:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448434.879379:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826334720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448434.879444:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448434.879964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334720 00000100:00100000:2.0:1788448434.879972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334720 00000100:00100000:2.0:1788448434.880024:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788448434.880034:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826334720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448434.880065:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788448434.880125:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826334720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448434.880133:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788448434.880230:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826334720:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448435.198552:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448436.224013:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448436.352389:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788448436.352669:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448436.927298:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826334848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448436.927381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448436.927697:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334848 00000100:00100000:1.0:1788448436.927706:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334848 00000100:00100000:2.0:1788448436.927928:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448436.927938:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826334976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448436.927971:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448436.928003:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826334976 00000100:00100000:2.0:1788448436.928007:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826334976 00000100:00100000:0.0:1788448436.928087:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448436.928096:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826335104:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448436.928126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448436.928162:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335104 00000100:00100000:0.0:1788448436.928165:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335104 00000100:00100000:0.0:1788448436.928215:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788448436.928223:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826335104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448436.928255:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448436.928299:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826335104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448436.928306:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788448436.928364:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826335104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448436.928597:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788448436.928605:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826334848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448436.928626:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448436.928666:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826334848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448436.928673:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788448436.928721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826334848:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788448436.932406:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448436.932975:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788448436.932992:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826334976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448436.933041:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448436.933147:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826334976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (5174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448436.933155:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448436.933989:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826334976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448437.246279:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448438.272589:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448438.974218:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826335360:0@lo:400:kworker.0 00000100:00100000:2.0:1788448438.974287:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448438.974406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335360 00000100:00100000:3.0:1788448438.974413:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335360 00000100:00100000:3.0:1788448438.974463:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788448438.974474:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826335360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.974563:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.974598:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.974640:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335232 00000100:00100000:0.0:1788448438.974644:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335232 00000100:00100000:0.0:1788448438.974673:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788448438.974694:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826335232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.974729:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826335232:12345-0@lo:400:kworker.0 Request processed in 37us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.974735:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788448438.974779:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826335232:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.975115:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826335488:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.975147:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.975181:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335488 00000100:00100000:0.0:1788448438.975185:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335488 00000100:00100000:0.0:1788448438.975211:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788448438.975218:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826335488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.975255:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826335488:12345-0@lo:400:kworker.0 Request processed in 37us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.975261:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788448438.975292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826335488:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.978659:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826335360:12345-0@lo:400:kworker.0 Request processed in 4177us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.978674:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788448438.984095:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826335360:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.985636:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826336000:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.985718:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448438.985752:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826336512:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.985776:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448438.985796:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788448438.985801:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826335872:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.985823:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448438.985841:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826336384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.985862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448438.985920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336000 00000100:00100000:1.0:1788448438.985927:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336000 00000100:00100000:1.0:1788448438.985977:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336512 00000100:00100000:1.0:1788448438.985980:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336512 00000100:00100000:1.0:1788448438.985996:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335872 00000100:00100000:1.0:1788448438.985998:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335872 00000100:00100000:1.0:1788448438.986008:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336384 00000100:00100000:1.0:1788448438.986010:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336384 00000100:00100000:1.0:1788448438.986027:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788448438.986035:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826336000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986169:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826335616:0@lo:400:kworker.0 00000100:00100000:2.0:1788448438.986284:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788448438.986294:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826336512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.986588:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826336128:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.986631:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826336640:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.986671:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788448438.986678:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826335744:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986702:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.986732:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826336256:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986755:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.986773:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826336768:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.986792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.986821:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336128 00000100:00100000:0.0:1788448438.986825:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336128 00000100:00100000:0.0:1788448438.986850:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336640 00000100:00100000:0.0:1788448438.986853:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336640 00000100:00100000:0.0:1788448438.986865:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336256 00000100:00100000:0.0:1788448438.986868:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336256 00000100:00100000:0.0:1788448438.986879:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336768 00000100:00100000:3.0:1788448438.986988:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335616 00000100:00100000:3.0:1788448438.986993:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335616 00000100:00100000:3.0:1788448438.987015:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788448438.987022:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826335872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987085:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826335872:12345-0@lo:400:kworker.0 Request processed in 63us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987092:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788448438.987109:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788448438.987115:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826336384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987145:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826336384:12345-0@lo:400:kworker.0 Request processed in 30us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987150:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788448438.987162:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788448438.987168:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826335616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987200:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826335616:12345-0@lo:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987206:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00080000:3.0:1788448438.987225:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448438.987228:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448438.987231:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448438.987232:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448438.987263:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826335616:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987323:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788448438.987331:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826336128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987366:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826336128:12345-0@lo:400:kworker.0 Request processed in 37us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987372:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788448438.987386:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788448438.987393:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826336640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987432:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826336640:12345-0@lo:400:kworker.0 Request processed in 40us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987439:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1788448438.987450:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788448438.987457:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826336256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987481:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826336256:12345-0@lo:400:kworker.0 Request processed in 25us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987487:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788448438.987507:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826335744 00000100:00100000:3.0:1788448438.987510:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826335744 00000100:00100000:3.0:1788448438.987534:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788448438.987540:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826335744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987569:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826335744:12345-0@lo:400:kworker.0 Request processed in 30us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.987575:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788448438.987598:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826335744:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987609:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826336256:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987618:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826336128:0@lo:400:kworker.0 00010000:00080000:3.0:1788448438.987628:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0e00 x1875323826336640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448438.987637:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826336640:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987678:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826335872:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.987687:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826336384:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.996272:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336768 00000100:00100000:0.0:1788448438.996372:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788448438.996383:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826336768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.996469:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826336768:12345-0@lo:400:kworker.0 Request processed in 89us (9675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.996476:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1788448438.996528:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0a80 x1875323826336768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448438.996542:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826336768:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.996672:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826336000:12345-0@lo:400:kworker.0 Request processed in 10635us (10952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448438.996694:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00080000:1.0:1788448438.996733:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e2300 x1875323826336000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448438.996744:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826336000:0@lo:400:kworker.0 00000100:00080000:3.0:1788448438.996842:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448438.998171:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826336512:12345-0@lo:400:kworker.0 Request processed in 11871us (12386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448438.998183:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00010000:00080000:1.0:1788448438.999812:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e3480 x1875323826336512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448439.000145:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826336512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448439.144662:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448439.144700:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448439.144737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448439.144833:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074176 00000100:00100000:1.0:1788448439.144842:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074176 00000100:00100000:1.0:1788448439.144930:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074048 00000100:00100000:1.0:1788448439.144934:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074048 00000100:00100000:1.0:1788448439.144959:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 264 00000100:00100000:1.0:1788448439.144984:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801074176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448439.145062:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801074176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448439.145071:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 264 00000100:00100000:1.0:1788448439.145089:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 265 00000100:00100000:1.0:1788448439.145096:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801074048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448439.145122:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801074048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448439.145127:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 265 00000100:00080000:0.0:1788448439.145662:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448439.145668:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448439.146064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801073920 00000100:00100000:3.0:1788448439.146071:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801073920 00000100:00100000:3.0:1788448439.146168:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 376 00000100:00100000:3.0:1788448439.146176:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801073920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448439.146228:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801073920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448439.146235:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 376 00000100:00100000:0.0:1788448439.171117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448439.171162:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448439.171230:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074432 00000100:00100000:2.0:1788448439.171240:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074432 00000100:00100000:2.0:1788448439.171328:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074560 00000100:00100000:2.0:1788448439.171332:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074560 00000100:00080000:0.0:1788448439.171455:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448439.171484:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448439.172482:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 266 00000100:00100000:2.0:1788448439.172502:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801074432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448439.172596:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801074432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 102us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448439.180620:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 267 00000100:00100000:0.0:1788448439.180650:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801074560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448439.180726:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801074560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (9563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448439.180734:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 267 00000100:00100000:3.0:1788448439.181457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448439.181742:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074304 00000100:00100000:3.0:1788448439.181750:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074304 00000100:00100000:3.0:1788448439.181810:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1788448439.181819:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2397:x1875323801074304:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788448439.181862:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803907 00000100:00080000:3.0:1788448439.181872:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fc082763000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448439.181940:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1788448439.184596:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448439.184617:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448439.189806:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 266 00000100:00100000:3.0:1788448439.191979:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+2:2397:x1875323801074304:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 10149us (10513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448439.191992:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00010000:00010000:2.0:1788448439.295944:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448439.486174:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826336896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448439.486252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448439.486510:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826336896 00000100:00100000:0.0:1788448439.486518:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826336896 00000100:00100000:0.0:1788448439.486570:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788448439.486580:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826336896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448439.486608:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448439.486653:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826336896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448439.486659:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1788448439.486862:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc18325c000 x1875323826336896/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448439.486916:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826336896:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448439.487324:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448439.487335:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826337024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448439.487368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448439.487441:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337024 00000100:00100000:1.0:1788448439.487456:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337024 00000100:00100000:1.0:1788448439.487506:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448439.487514:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826337024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448439.487527:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448439.487571:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826337024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448439.487577:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:2.0:1788448439.487712:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d1f80 x1875323826337024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448439.487736:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826337024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448439.998270:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448439.998293:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826337152:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448439.998370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448439.998757:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337152 00000100:00100000:3.0:1788448439.998766:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337152 00000100:00100000:3.0:1788448439.998814:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788448439.998966:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826337152:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448439.998999:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788448439.999056:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826337152:12345-0@lo:41:osp-pre-0-1.0 Request processed in 234us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448439.999079:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788448439.999154:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826337152:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448440.318285:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448441.342321:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448442.046201:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826337280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448442.046280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448442.049079:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337280 00000100:00100000:2.0:1788448442.049093:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337280 00000100:00100000:2.0:1788448442.049168:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788448442.049180:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826337280:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448442.049191:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826337408:0@lo:41:osp-pre-1-0.0 00002000:00000024:2.0:1788448442.049210:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448442.049318:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826337536:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788448442.049388:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448442.056569:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826337280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7384us (10279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448442.056585:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788448442.056757:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826337280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448442.066593:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448442.066742:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337536 00000100:00100000:0.0:1788448442.066751:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337536 00000100:00100000:0.0:1788448442.066816:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788448442.066826:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826337536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448442.066852:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448442.066935:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826337536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448442.066954:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788448442.067003:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826337536:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788448442.070775:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448442.077558:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448442.085583:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337408 00000100:00100000:3.0:1788448442.085599:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337408 00000100:00100000:0.0:1788448442.086279:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788448442.086313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826337408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448442.086355:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448442.086442:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826337408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (8891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448442.086449:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788448442.086592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826337408:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788448442.366167:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448443.400169:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448444.094278:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826337664:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094356:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094431:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826338176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094457:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094478:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826338688:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094500:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094515:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826339200:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094533:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094554:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788448444.094559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826337792:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094582:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094597:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094625:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094640:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.094665:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338688 00000100:00100000:0.0:1788448444.094672:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338688 00000100:00100000:0.0:1788448444.094714:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339200 00000100:00100000:0.0:1788448444.094717:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339200 00000100:00100000:0.0:1788448444.094737:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788448444.094746:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826338688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094805:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826338688:12345-0@lo:400:kworker.0 Request processed in 60us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.094813:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788448444.094828:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788448444.094834:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826339200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.094858:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826339200:12345-0@lo:400:kworker.0 Request processed in 24us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.094864:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788448444.094912:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337792 00000100:00100000:0.0:1788448444.094915:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337792 00000100:00100000:0.0:1788448444.094935:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338304 00000100:00100000:0.0:1788448444.094937:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338304 00000100:00100000:0.0:1788448444.094953:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338816 00000100:00100000:0.0:1788448444.094955:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338816 00000100:00100000:0.0:1788448444.094970:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788448444.094976:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826337792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095003:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826337792:12345-0@lo:400:kworker.0 Request processed in 28us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095009:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788448444.095020:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788448444.095025:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826338304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095046:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826338304:12345-0@lo:400:kworker.0 Request processed in 21us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095051:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788448444.095061:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788448444.095066:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826338816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095098:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826338816:12345-0@lo:400:kworker.0 Request processed in 32us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788448444.095135:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826337792:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095145:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095152:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826338816:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095160:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826338688:0@lo:400:kworker.0 00010000:00080000:0.0:1788448444.095170:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e1c00 x1875323826339200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448444.095179:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826339200:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095203:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338176 00000100:00100000:0.0:1788448444.095206:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338176 00000100:00100000:0.0:1788448444.095226:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448444.095232:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826338176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095263:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826338176:12345-0@lo:400:kworker.0 Request processed in 32us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448444.095300:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826338176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095315:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826338048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.095355:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338048 00000100:00100000:0.0:1788448444.095357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338048 00000100:00100000:0.0:1788448444.095376:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788448444.095388:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826338048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095417:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826338048:12345-0@lo:400:kworker.0 Request processed in 29us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788448444.095446:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826338048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095451:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.095487:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338560 00000100:00100000:0.0:1788448444.095490:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338560 00000100:00100000:0.0:1788448444.095510:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788448444.095515:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095539:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826338560:12345-0@lo:400:kworker.0 Request processed in 24us (67us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095545:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788448444.095565:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095571:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826339072:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095589:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.095603:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339072 00000100:00100000:0.0:1788448444.095606:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339072 00000100:00100000:0.0:1788448444.095623:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788448444.095628:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826339072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095652:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826339072:12345-0@lo:400:kworker.0 Request processed in 24us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095656:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:0.0:1788448444.095676:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e2a00 x1875323826339072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448444.095693:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826339072:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095708:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788448444.095713:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826337920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.095752:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337920 00000100:00100000:0.0:1788448444.095755:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337920 00000100:00100000:0.0:1788448444.095769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788448444.095774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095798:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826337920:12345-0@lo:400:kworker.0 Request processed in 24us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095803:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788448444.095823:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826337920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095828:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095859:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.095877:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338432 00000100:00100000:0.0:1788448444.095899:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338432 00000100:00100000:0.0:1788448444.095921:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788448444.095927:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095952:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826338432:12345-0@lo:400:kworker.0 Request processed in 25us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.095957:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00010000:00080000:0.0:1788448444.095979:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e2300 x1875323826338432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448444.095987:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.095998:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826338944:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.096019:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.096036:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826338944 00000100:00100000:0.0:1788448444.096039:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826338944 00000100:00100000:0.0:1788448444.096059:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788448444.096064:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826338944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.096089:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826338944:12345-0@lo:400:kworker.0 Request processed in 25us (69us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.096095:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00010000:00080000:0.0:1788448444.096117:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e0e00 x1875323826338944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448444.096125:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826338944:0@lo:400:kworker.0 00000100:00080000:2.0:1788448444.096292:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448444.096296:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448444.096299:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448444.096301:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448444.097571:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826337664 00000100:00100000:3.0:1788448444.097579:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826337664 00000100:00100000:3.0:1788448444.097629:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788448444.097638:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826337664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448444.097714:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826337664:12345-0@lo:400:kworker.0 Request processed in 77us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.097720:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788448444.098274:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826337664:0@lo:400:kworker.0 00000100:00100000:2.0:1788448444.278576:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448444.278628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448444.278664:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448444.278702:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448444.278749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448444.278777:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074944 00000100:00100000:2.0:1788448444.278786:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074944 00000100:00100000:2.0:1788448444.278839:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075200 00000100:00100000:2.0:1788448444.278843:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075200 00000100:00100000:3.0:1788448444.279021:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074816 00000100:00100000:3.0:1788448444.279026:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074816 00000100:00100000:3.0:1788448444.279061:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075072 00000100:00100000:3.0:1788448444.279065:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075072 00000100:00100000:3.0:1788448444.279085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 274 00000100:00100000:3.0:1788448444.279094:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801074944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448444.279173:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801074944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.279181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 274 00000100:00100000:3.0:1788448444.279199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 275 00000100:00100000:3.0:1788448444.279206:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801075200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448444.279243:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801075200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.279250:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 275 00000100:00100000:3.0:1788448444.279264:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 276 00000100:00100000:3.0:1788448444.279270:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801074816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448444.279305:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801074816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.279311:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 276 00000100:00100000:3.0:1788448444.279324:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00100000:3.0:1788448444.279341:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801075072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448444.279370:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801075072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.279375:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00080000:3.0:1788448444.279527:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448444.279531:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448444.281257:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801074688 00000100:00100000:0.0:1788448444.281268:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801074688 00000100:00100000:0.0:1788448444.281340:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 378 00000100:00100000:0.0:1788448444.281349:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801074688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448444.281424:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801074688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.281431:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 378 00010000:00010000:2.0:1788448444.416875:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448444.610466:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826339328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448444.610566:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448444.610663:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339328 00000100:00100000:1.0:1788448444.610672:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339328 00000100:00100000:1.0:1788448444.610739:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788448444.610750:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826339328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448444.610785:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448444.610834:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826339328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448444.610842:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:1.0:1788448444.610947:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc18325ce00 x1875323826339328/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448444.610981:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826339328:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788448444.615424:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:1.0:1788448444.615439:0:8427:0:(genops.c:885:class_export_put()) final put ffff9fc082763800/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:3.0:1788448444.615794:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082763800/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-OST0000 00000020:00000080:3.0:1788448444.615857:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc082763000 for lustre-OST0000 00000100:00100000:3.0:1788448444.624793:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448444.624915:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.625586:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339456 00000100:00100000:0.0:1788448444.625596:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339456 00000100:00100000:0.0:1788448444.625653:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788448444.625664:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826339456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448444.625722:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1788448444.630591:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc18325ce00 x1875323826339456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448444.630626:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448444.631045:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826339456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5378us (6127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.631058:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788448445.118365:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826339584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448445.118462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448445.118562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339584 00000100:00100000:3.0:1788448445.118572:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339584 00000100:00100000:3.0:1788448445.118626:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788448445.118637:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826339584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448445.118680:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788448445.118729:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826339584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448445.118736:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788448445.118845:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826339584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788448445.438927:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448446.463595:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448446.591284:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788448446.596579:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448447.167355:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448447.167387:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826339712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448447.167477:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448447.168134:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339712 00000100:00100000:1.0:1788448447.168156:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339712 00000100:00100000:1.0:1788448447.168227:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788448447.168239:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826339712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448447.168304:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788448447.168371:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826339712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448447.168380:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788448447.168436:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448447.168448:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826339840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448447.168484:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448447.168523:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339840 00000100:00100000:1.0:1788448447.168527:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339840 00000100:00100000:1.0:1788448447.168566:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788448447.168573:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826339840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448447.168594:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448447.168629:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826339840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448447.168635:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788448447.168650:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448447.168692:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826339840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448447.168743:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826339712:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448447.170165:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448447.170186:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826339968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448447.170250:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448447.170332:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826339968 00000100:00100000:3.0:1788448447.170339:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826339968 00000100:00100000:3.0:1788448447.170394:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788448447.170403:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826339968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448447.170426:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448447.170469:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826339968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448447.170476:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:3.0:1788448447.170498:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448447.170541:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826339968:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448447.491964:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448448.511669:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448449.215083:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826340096:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215189:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215270:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826340608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215326:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826341120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215354:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215374:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826341632:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215423:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788448449.215430:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826340480:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215459:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215479:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826340992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215502:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215520:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826341504:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215553:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215586:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826340224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215613:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215633:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826340736:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215675:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826341248:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215697:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215717:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788448449.215743:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826340352:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215769:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215792:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826340864:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215855:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826341376:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.215913:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448449.215951:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340608 00000100:00100000:1.0:1788448449.215960:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340608 00000100:00100000:1.0:1788448449.216002:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340352 00000100:00100000:1.0:1788448449.216006:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340352 00000100:00100000:1.0:1788448449.216022:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788448449.216030:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826340608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216094:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826340608:12345-0@lo:400:kworker.0 Request processed in 64us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788448449.216121:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788448449.216127:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826340352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216162:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826340352:12345-0@lo:400:kworker.0 Request processed in 35us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216168:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788448449.216185:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341120 00000100:00100000:1.0:1788448449.216188:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341120 00000100:00100000:1.0:1788448449.216215:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341632 00000100:00100000:1.0:1788448449.216218:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341632 00000100:00100000:1.0:1788448449.216228:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340992 00000100:00100000:1.0:1788448449.216231:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340992 00000100:00100000:1.0:1788448449.216240:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341504 00000100:00100000:1.0:1788448449.216242:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341504 00000100:00100000:1.0:1788448449.216287:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448449.216293:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826341120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216326:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826341120:12345-0@lo:400:kworker.0 Request processed in 33us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216332:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448449.216341:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788448449.216347:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826341632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216370:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826341632:12345-0@lo:400:kworker.0 Request processed in 24us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216375:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788448449.216385:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788448449.216390:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826340992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216414:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826340992:12345-0@lo:400:kworker.0 Request processed in 24us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216419:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788448449.216430:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448449.216435:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826341504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216458:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826341504:12345-0@lo:400:kworker.0 Request processed in 23us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216463:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448449.216490:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340480 00000100:00100000:1.0:1788448449.216493:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340480 00000100:00100000:1.0:1788448449.216514:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340224 00000100:00100000:1.0:1788448449.216517:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340224 00000100:00100000:1.0:1788448449.216526:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340736 00000100:00100000:1.0:1788448449.216529:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340736 00000100:00100000:1.0:1788448449.216538:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341248 00000100:00100000:1.0:1788448449.216547:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341248 00000100:00100000:1.0:1788448449.216561:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340864 00000100:00100000:1.0:1788448449.216564:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340864 00000100:00100000:1.0:1788448449.216577:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341376 00000100:00100000:1.0:1788448449.216579:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341376 00000100:00100000:1.0:1788448449.216592:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788448449.216598:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826340480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216629:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826340480:12345-0@lo:400:kworker.0 Request processed in 32us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216635:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788448449.216648:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788448449.216654:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826340224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216681:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826340224:12345-0@lo:400:kworker.0 Request processed in 28us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216687:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788448449.216698:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788448449.216703:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826340736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216726:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826340736:12345-0@lo:400:kworker.0 Request processed in 23us (1069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216731:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788448449.216740:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788448449.216745:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826341248:12345-0@lo:400:kworker.0 Request processed in 24us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216776:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788448449.216788:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788448449.216794:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826340864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826340864:12345-0@lo:400:kworker.0 Request processed in 36us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216837:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788448449.216850:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788448449.216857:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826341376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.216908:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826341376:12345-0@lo:400:kworker.0 Request processed in 51us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.216914:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788448449.216993:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826340352:0@lo:400:kworker.0 00010000:00080000:1.0:1788448449.217010:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f7800 x1875323826340864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448449.217022:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826340864:0@lo:400:kworker.0 00010000:00080000:1.0:1788448449.217034:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f6680 x1875323826341376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448449.217042:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826341376:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217053:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826340224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217064:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826340736:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217074:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826341248:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217124:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826340480:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217135:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826340992:0@lo:400:kworker.0 00010000:00080000:1.0:1788448449.217146:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f7100 x1875323826341504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448449.217163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826341504:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217176:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826340608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448449.217186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826341120:0@lo:400:kworker.0 00010000:00080000:1.0:1788448449.217196:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f5500 x1875323826341632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448449.217205:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826341632:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.222373:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826340096 00000100:00100000:3.0:1788448449.222396:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826340096 00000100:00100000:3.0:1788448449.222490:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788448449.222508:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.222635:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826340096:12345-0@lo:400:kworker.0 Request processed in 135us (7446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.222644:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00080000:3.0:1788448449.222689:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448449.222696:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448449.222701:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448449.222704:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448449.222770:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826340096:0@lo:400:kworker.0 00000100:00100000:2.0:1788448449.388183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448449.388238:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448449.388275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448449.388295:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448449.388320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448449.388708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075328 00000100:00100000:3.0:1788448449.388785:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075328 00000100:00100000:3.0:1788448449.388854:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 380 00000100:00100000:3.0:1788448449.388867:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801075328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448449.388991:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801075328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 125us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.389000:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 380 00000100:00100000:1.0:1788448449.391354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075584 00000100:00100000:1.0:1788448449.391374:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075584 00000100:00100000:1.0:1788448449.391455:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075840 00000100:00100000:1.0:1788448449.391459:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075840 00000100:00100000:1.0:1788448449.391480:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075456 00000100:00100000:1.0:1788448449.391483:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075456 00000100:00100000:1.0:1788448449.391499:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075712 00000100:00100000:1.0:1788448449.391502:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075712 00000100:00100000:1.0:1788448449.391525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 284 00000100:00100000:1.0:1788448449.391535:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801075584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:2.0:1788448449.391906:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448449.391912:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448449.392325:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801075584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 788us (4084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.392335:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 284 00000100:00100000:1.0:1788448449.392368:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 285 00000100:00100000:1.0:1788448449.392378:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801075840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448449.392405:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801075840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (4130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.392412:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 285 00000100:00100000:1.0:1788448449.392446:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 286 00000100:00100000:1.0:1788448449.392453:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801075456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448449.392484:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801075456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (4189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.392490:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 286 00000100:00100000:1.0:1788448449.392504:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:1.0:1788448449.392511:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801075712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448449.392536:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801075712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448449.394169:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 287 00010000:00010000:2.0:1788448449.537352:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448449.728743:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448449.728773:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826341760:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448449.728861:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448449.728971:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341760 00000100:00100000:0.0:1788448449.728981:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341760 00000100:00100000:0.0:1788448449.729042:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788448449.729054:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826341760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448449.729094:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448449.729164:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826341760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448449.729173:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:0.0:1788448449.729223:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc184e66300 x1875323826341760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448449.729246:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826341760:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448449.729681:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448449.729697:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826341888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448449.729745:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.729781:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826341888 00000100:00100000:3.0:1788448449.729786:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826341888 00000100:00100000:3.0:1788448449.729823:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788448449.729831:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826341888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448449.729863:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448449.729921:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826341888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.729928:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:3.0:1788448449.729962:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f5180 x1875323826341888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448449.729979:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826341888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448450.238313:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826342016:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448450.238419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448450.238718:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342016 00000100:00100000:1.0:1788448450.238729:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342016 00000100:00100000:1.0:1788448450.238804:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788448450.238816:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826342016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448450.238861:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788448450.238948:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826342016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448450.238956:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788448450.239046:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826342016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788448450.558221:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448451.462062:0:14064:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:14:09 (1788448449) 00010000:00010000:3.0:1788448451.590003:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448452.286902:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448452.286925:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826342144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448452.286992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448452.297407:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448452.297428:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826342272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448452.297490:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448452.308800:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448452.308830:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826342400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448452.308924:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448452.309002:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342400 00000100:00100000:0.0:1788448452.309010:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342400 00000100:00100000:0.0:1788448452.309055:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788448452.309078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826342400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448452.309111:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448452.309155:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826342400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448452.309162:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788448452.309221:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826342400:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448452.316166:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342144 00000100:00100000:3.0:1788448452.316183:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342144 00000100:00100000:3.0:1788448452.316371:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342272 00000100:00100000:3.0:1788448452.316374:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342272 00000100:00100000:3.0:1788448452.316393:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788448452.316402:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826342144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448452.316433:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448452.316507:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826342144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (29515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448452.316515:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788448452.316531:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788448452.316536:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826342272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448452.316545:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448452.316572:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826342272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (19081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448452.316578:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1788448452.317865:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448452.321552:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ee0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826342272:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448452.325433:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826342144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448452.606114:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448453.278581:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448453.278810:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801075968 00000100:00100000:2.0:1788448453.278820:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801075968 00000100:00100000:2.0:1788448453.278939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:2.0:1788448453.278951:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:11079:x1875323801075968:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448453.278968:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448453.278989:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b8039e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05ad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.279074:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8039ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.279087:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8039ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.279100:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8039ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448453.279144:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448453.279148:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448453.279184:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8039ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.279207:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b8039e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05ad expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.279223:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8039ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05ad expref: 6 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.279244:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb543a00) 00010000:00010000:2.0:1788448453.279246:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448453.279250:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330800, rc 0) 00000100:00080000:3.0:1788448453.279394:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448453.279944:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:11079:x1875323801075968:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 993us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448453.279952:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:3.0:1788448453.301127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448453.302940:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076096 00000100:00100000:1.0:1788448453.302954:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076096 00000100:00100000:1.0:1788448453.303726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:1.0:1788448453.303754:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:11080:x1875323801076096:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448453.303774:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448453.303796:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b8039f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05b4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.303861:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.303875:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.303909:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.303925:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.303933:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.303939:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304006:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031400/0xf45a9e4e6b803a0a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304014:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031400/0xf45a9e4e6b803a0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304019:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031400/0xf45a9e4e6b803a0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448453.304061:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448453.304065:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448453.304082:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031400/0xf45a9e4e6b803a0a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304102:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304109:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304115:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304121:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448453.304125:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304131:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304141:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb543a00) 00010000:00010000:1.0:1788448453.304144:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448453.304149:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304160:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8039fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304173:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304185:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304192:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304197:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448453.304200:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304206:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304212:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fc183b52f00) 00010000:00010000:1.0:1788448453.304214:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448453.304216:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304221:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803a03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304259:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b8039f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05b4 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304271:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031400/0xf45a9e4e6b803a0a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05b4 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448453.304277:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc183b52700) 00010000:00010000:1.0:1788448453.304280:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448453.304287:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031400, rc 0) 00000100:00100000:1.0:1788448453.304352:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11080:x1875323801076096:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 602us (3233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448453.304360:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:0.0:1788448453.306471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448453.306550:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076224 00000100:00100000:3.0:1788448453.306559:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076224 00000100:00100000:3.0:1788448453.306614:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1788448453.306623:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11080:x1875323801076224:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788448453.306687:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11080:x1875323801076224:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 Request processed in 65us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448453.306695:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448453.312583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448453.312717:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076480 00000100:00100000:2.0:1788448453.312727:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076480 00000100:00100000:2.0:1788448453.312799:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:2.0:1788448453.312810:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11080:x1875323801076480:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448453.312841:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448453.312862:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803a11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05bb expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.312954:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.313682:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.315075:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.315573:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.315586:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.315595:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.317790:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b803a26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.317809:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b803a26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318139:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b803a26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448453.318172:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788448453.318558:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318567:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318574:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318580:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448453.318585:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318592:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318604:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc183b52700) 00010000:00010000:2.0:1788448453.318607:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448453.318612:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318618:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803a18 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318632:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318638:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318776:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318781:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448453.318784:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318791:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318799:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc1bb543000) 00010000:00010000:2.0:1788448453.318802:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448453.318805:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.318810:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803a1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.319592:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803a11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05bb expref: 10 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.319613:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b803a26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05bb expref: 9 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448453.319621:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:2.0:1788448453.319623:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448453.319625:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330c00, rc 0) 00000100:00100000:2.0:1788448453.319854:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11080:x1875323801076480:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 7044us (7278us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788448453.319873:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:3.0:1788448453.325367:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448453.325850:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076608 00000100:00100000:1.0:1788448453.325860:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076608 00000100:00100000:1.0:1788448453.326183:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:1.0:1788448453.326195:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11080:x1875323801076608:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788448453.326371:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11080:x1875323801076608:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 178us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448453.326379:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1788448453.337148:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448453.337253:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076736 00000100:00100000:2.0:1788448453.337262:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076736 00000100:00100000:2.0:1788448453.337333:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1788448453.337356:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:11080:x1875323801076736:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788448453.337559:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788448453.338187:0:9023:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 787us 00000100:00100000:0.0:1788448453.354414:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:11080:x1875323801076736:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 17060us (17263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448453.354428:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00010000:00010000:2.0:1788448453.630624:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448453.759003:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788448453.760379:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448454.334591:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826342784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.334653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.334704:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826343296:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.334729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.334754:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826343808:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.334787:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.334810:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788448454.334816:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826342912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.334839:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.334858:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826343424:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.334896:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.334911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826343936:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.334930:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.334958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342784 00000100:00100000:3.0:1788448454.334963:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342784 00000100:00100000:3.0:1788448454.335003:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788448454.335030:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826342784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.335078:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826342784:12345-0@lo:400:kworker.0 Request processed in 50us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448454.335084:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788448454.335120:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826342784:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335264:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826342656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335293:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335317:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826343168:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335334:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335358:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335400:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:1.0:1788448454.335405:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826342528:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335432:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335452:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826343040:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335471:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335584:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826343552:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335608:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335635:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826344064:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.335685:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343296 00000100:00100000:1.0:1788448454.335689:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343296 00000100:00100000:1.0:1788448454.335724:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343808 00000100:00100000:1.0:1788448454.335727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343808 00000100:00100000:1.0:1788448454.335740:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342912 00000100:00100000:1.0:1788448454.335743:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342912 00000100:00100000:1.0:1788448454.335755:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342656 00000100:00100000:1.0:1788448454.335758:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342656 00000100:00100000:1.0:1788448454.335770:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343168 00000100:00100000:1.0:1788448454.335772:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343168 00000100:00100000:1.0:1788448454.335786:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343680 00000100:00100000:1.0:1788448454.335788:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343680 00000100:00100000:1.0:1788448454.335804:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788448454.335810:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826343296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826343296:12345-0@lo:400:kworker.0 Request processed in 39us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.335856:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788448454.335869:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788448454.335876:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826343808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335935:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826343808:12345-0@lo:400:kworker.0 Request processed in 60us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.335941:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788448454.335952:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788448454.335957:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826342912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.335981:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826342912:12345-0@lo:400:kworker.0 Request processed in 24us (1142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.335997:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788448454.336009:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788448454.336015:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826342656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336050:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826342656:12345-0@lo:400:kworker.0 Request processed in 35us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336056:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788448454.336068:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788448454.336075:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826343168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336100:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826343168:12345-0@lo:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336105:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788448454.336117:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788448454.336123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826343680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336147:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826343680:12345-0@lo:400:kworker.0 Request processed in 25us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336152:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788448454.336173:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343424 00000100:00100000:1.0:1788448454.336176:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343424 00000100:00100000:1.0:1788448454.336194:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343936 00000100:00100000:1.0:1788448454.336197:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343936 00000100:00100000:1.0:1788448454.336208:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343552 00000100:00100000:1.0:1788448454.336211:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343552 00000100:00100000:1.0:1788448454.336222:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826344064 00000100:00100000:1.0:1788448454.336237:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826344064 00000100:00100000:1.0:1788448454.336252:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788448454.336258:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826343424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336299:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826343424:12345-0@lo:400:kworker.0 Request processed in 41us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336305:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788448454.336318:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788448454.336323:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826343936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336348:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826343936:12345-0@lo:400:kworker.0 Request processed in 26us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336354:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788448454.336365:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788448454.336371:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826343552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336398:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826343552:12345-0@lo:400:kworker.0 Request processed in 27us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336403:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788448454.336414:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788448454.336420:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826344064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.336444:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826344064:12345-0@lo:400:kworker.0 Request processed in 25us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.336450:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788448454.337972:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826342528 00000100:00100000:1.0:1788448454.337980:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826342528 00000100:00100000:1.0:1788448454.338143:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788448454.338152:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826342528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.338199:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826342528:12345-0@lo:400:kworker.0 Request processed in 49us (2766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.338207:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00080000:1.0:1788448454.341025:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448454.341033:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448454.341036:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448454.341039:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448454.341069:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826343040 00000100:00100000:1.0:1788448454.341077:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826343040 00000100:00100000:1.0:1788448454.341149:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448454.341159:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826343040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341234:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826343040:12345-0@lo:400:kworker.0 Request processed in 66us (5750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.341241:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448454.341306:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826342528:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341318:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826343040:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341329:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826343552:0@lo:400:kworker.0 00010000:00080000:1.0:1788448454.341342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083c68700 x1875323826344064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448454.341352:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c68700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826344064:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341362:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826342656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341372:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826343168:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341562:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826343680:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341605:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826342912:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.341615:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826343424:0@lo:400:kworker.0 00010000:00080000:1.0:1788448454.341626:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083c69f80 x1875323826343936/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448454.341642:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826343936:0@lo:400:kworker.0 00010000:00080000:1.0:1788448454.341656:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f5f80 x1875323826343296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448454.341664:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826343296:0@lo:400:kworker.0 00010000:00080000:1.0:1788448454.341674:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083c68000 x1875323826343808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448454.341682:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826343808:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.503306:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448454.503451:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448454.503479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448454.503499:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448454.503520:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448454.503541:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801077120 00000100:00100000:1.0:1788448454.503549:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801077120 00000100:00100000:1.0:1788448454.503589:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801077376 00000100:00100000:1.0:1788448454.503592:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801077376 00000100:00100000:1.0:1788448454.503613:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076992 00000100:00100000:1.0:1788448454.503616:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076992 00000100:00100000:1.0:1788448454.503625:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801077248 00000100:00100000:1.0:1788448454.503627:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801077248 00000100:00100000:1.0:1788448454.503643:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 294 00000100:00100000:1.0:1788448454.503651:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801077120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448454.503719:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801077120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.503728:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 294 00000100:00100000:1.0:1788448454.503753:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:1.0:1788448454.503759:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801077376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448454.503785:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801077376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.503791:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:1.0:1788448454.503804:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 296 00000100:00100000:1.0:1788448454.503810:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801076992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448454.503832:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801076992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.503838:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 296 00000100:00100000:1.0:1788448454.503849:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00100000:1.0:1788448454.503856:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801077248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448454.503878:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801077248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.503905:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00080000:1.0:1788448454.503930:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448454.503933:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448454.505656:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801076864 00000100:00100000:2.0:1788448454.505666:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801076864 00000100:00100000:2.0:1788448454.505759:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 382 00000100:00100000:2.0:1788448454.505769:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801076864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448454.505827:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801076864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (2529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448454.505834:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 382 00010000:00010000:1.0:1788448454.660247:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448454.848361:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448454.848382:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826344192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448454.848444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.848507:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826344192 00000100:00100000:3.0:1788448454.848514:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826344192 00000100:00100000:3.0:1788448454.848557:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788448454.848565:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826344192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448454.848590:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448454.848632:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826344192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448454.848639:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00010000:00080000:3.0:1788448454.848675:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083c69880 x1875323826344192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448454.848691:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826344192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448454.852056:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448454.852077:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826344320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448454.852146:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448454.852314:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826344320 00000100:00100000:2.0:1788448454.852321:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826344320 00000100:00100000:2.0:1788448454.852372:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788448454.852382:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826344320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448454.852400:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448454.852438:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826344320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448454.852444:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:0.0:1788448454.853583:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc183ea9c00 x1875323826344320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448454.853604:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826344320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448455.359360:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448455.359383:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826344448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448455.359448:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448455.359616:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826344448 00000100:00100000:3.0:1788448455.359625:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826344448 00000100:00100000:3.0:1788448455.359677:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788448455.359686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826344448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448455.359717:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788448455.359763:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826344448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448455.359777:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788448455.360459:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c69880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826344448:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788448455.688768:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448456.161493:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.161569:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801077504 00000100:00100000:3.0:1788448456.161578:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801077504 00000100:00100000:3.0:1788448456.161656:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:3.0:1788448456.161667:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11123:x1875323801077504:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448456.161691:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448456.161710:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b803a34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05c2 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161770:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161783:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161795:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161810:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161817:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161823:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161860:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161900:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161907:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.161913:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a8600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448456.162022:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162031:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162043:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb543a00) 00010000:00010000:3.0:1788448456.162046:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448456.162049:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162054:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a8600/0xf45a9e4e6b803a3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162066:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162072:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162077:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162081:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448456.162090:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162095:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162102:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc1bb42bf00) 00010000:00010000:3.0:1788448456.162104:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448456.162106:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162112:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b803a42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162142:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b803a34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05c2 expref: 10 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788448456.162252:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448456.162330:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb543a00) 00010000:00010000:3.0:1788448456.162333:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448456.162338:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9c00/0xf45a9e4e6b803a34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05c2 expref: 10 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.162349:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9c00, rc 0) 00000100:00100000:3.0:1788448456.162406:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11123:x1875323801077504:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 741us (921us total) trans 0 rc 301/301 00000100:00100000:3.0:1788448456.162414:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:1.0:1788448456.169242:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.171064:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801077760 00000100:00100000:3.0:1788448456.171076:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801077760 00000100:00100000:3.0:1788448456.171224:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:3.0:1788448456.171236:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11123:x1875323801077760:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:3.0:1788448456.171305:0:9023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448456.171329:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b8039ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05ad expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171345:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb543a00) 00010000:00010000:3.0:1788448456.171354:0:9023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448456.171408:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171421:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171431:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171454:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171463:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171470:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171938:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171948:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171955:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448456.171979:0:9023:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088c8441c reply state 00000000b9f5a031 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171989:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.171995:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448456.171998:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448456.172001:0:9023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788448456.172005:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788448456.172011:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172018:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172025:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172030:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448456.172034:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172042:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172050:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:3.0:1788448456.172052:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448456.172056:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172072:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b803a49 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448456.172086:0:9023:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000088c8441c reply state 00000000b9f5a031 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172094:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.172099:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc1bb42bb00) 00010000:00010000:3.0:1788448456.172101:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448456.172103:0:9023:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788448456.172190:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:11123:x1875323801077760:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 956us (2953us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788448456.172198:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1788448456.294282:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.297122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801077888 00000100:00100000:3.0:1788448456.297136:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801077888 00000100:00100000:3.0:1788448456.297197:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:3.0:1788448456.297206:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:11131:x1875323801077888:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:3.0:1788448456.297238:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448456.297258:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803a5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05c9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.297312:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b803a65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.297324:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b803a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.297351:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b803a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448456.297397:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448456.297401:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448456.297437:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b803a65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.297467:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803a5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05c9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.297484:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b803a65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05c9 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.297492:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:3.0:1788448456.297495:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448456.297499:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ee00, rc 0) 00000100:00100000:3.0:1788448456.297559:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:11131:x1875323801077888:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 353us (3284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448456.297566:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:3.0:1788448456.383775:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448456.385023:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801078016 00000100:00100000:0.0:1788448456.385035:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801078016 00000100:00100000:0.0:1788448456.385102:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1788448456.385112:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:11137:x1875323801078016:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1788448456.385130:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448456.385393:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803a6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05d0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385459:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385471:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385483:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385493:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385500:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385507:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385584:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b803a81 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385593:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b803a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385601:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b803a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448456.385633:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788448456.385636:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448456.385673:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b803a81 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385693:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385699:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385705:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385710:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.385714:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385722:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385734:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:0.0:1788448456.385737:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.385741:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385746:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803a73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385757:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385763:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385768:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385779:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.385782:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385789:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385797:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc1bb42bb00) 00010000:00010000:0.0:1788448456.385799:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.385802:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385807:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803a7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385831:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803a6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d0 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385843:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b803a81 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d0 expref: 12 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.385850:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448456.385852:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788448456.385854:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fe00, rc 0) 00000100:00100000:0.0:1788448456.389615:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:11137:x1875323801078016:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4492us (5838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448456.389627:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:1.0:1788448456.398389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.398463:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801078272 00000100:00100000:3.0:1788448456.398472:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801078272 00000100:00100000:3.0:1788448456.398528:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:3.0:1788448456.398538:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:11137:x1875323801078272:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448456.398563:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448456.398581:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803a88 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05d7 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.398689:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.398703:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.398714:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400099:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400116:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400126:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448456.400490:0:9023:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1788448456.400613:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400622:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400629:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400656:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400663:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400670:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400675:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448456.400680:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400702:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400714:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448456.400717:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448456.400722:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400728:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803a8f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448456.400742:0:9023:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b44ce65 reply state 00000000482bf5db transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400752:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400758:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:2.0:1788448456.400761:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448456.400763:0:9023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788448456.400793:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803a88 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 15 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400808:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 14 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.400816:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:2.0:1788448456.400818:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448456.400820:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330a00, rc 0) 00000100:00100000:2.0:1788448456.401008:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11137:x1875323801078272:12345-192.168.206.21@tcp:101:bash.0 Request processed in 2471us (2628us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788448456.401022:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:1.0:1788448456.406845:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.406947:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801078400 00000100:00100000:2.0:1788448456.406956:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801078400 00000100:00100000:2.0:1788448456.407007:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:2.0:1788448456.407016:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875323801078400:12345-192.168.206.21@tcp:8:bash.0 00010000:00080000:2.0:1788448456.407049:0:8539:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1788448456.407077:0:8539:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b803aab 00002000:00100000:2.0:1788448456.407087:0:8539:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5f39813a-d0bd-49ee-95eb-2130028b48f0/ffff9fc1bf885800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448456.407097:0:8539:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448456.407172:0:8539:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788448456.407198:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf883000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448456.407802:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801078400:12345-192.168.206.21@tcp:8:bash.0 Request processed in 783us (962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448456.407811:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:3.0:1788448456.418690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.418791:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801078528 00000100:00100000:1.0:1788448456.418824:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801078528 00000100:00100000:1.0:1788448456.418932:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1788448456.418943:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801078528:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448456.418958:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.418981:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05de expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448456.419006:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448456.419024:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=373s v=(0 0) 00010000:00010000:1.0:1788448456.419028:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448456.419037:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.419057:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.419070:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:1.0:1788448456.419506:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:0:x1875323801078528:12345-192.168.206.21@tcp:101:bash.0 Request processed in 564us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.419514:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00080000:2.0:1788448456.419784:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448456.430869:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.431069:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801078656 00000100:00100000:1.0:1788448456.431077:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801078656 00000100:00100000:1.0:1788448456.431128:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:1.0:1788448456.431139:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11137:x1875323801078656:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448456.431156:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.431174:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05e5 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.431243:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.431252:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448456.431257:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448456.431325:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.431373:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.431393:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 8 pid: 8434 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448456.431407:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875323826344576:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448456.431575:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0341b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448456.436779:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.436914:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801078784 00000100:00100000:2.0:1788448456.436923:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801078784 00010000:00010000:2.0:1788448456.436959:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 9 pid: 8434 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448456.436988:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448456.436996:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801078784:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448456.437009:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448456.437027:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 9 pid: 8434 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.437053:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 9 pid: 8434 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.437076:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448456.437081:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448456.437088:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.437098:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.437131:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448456.437144:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6502:1875323826344704:192.168.206.21@tcp:105: 00000100:00100000:2.0:1788448456.437211:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb000 going to sleep for 11 seconds 00010000:00010000:1.0:1788448456.437731:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ab2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05de expref: 9 pid: 8434 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448456.437747:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875323826344576:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448456.437766:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.437777:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031600, rc 0) 00000100:00100000:1.0:1788448456.437860:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:11137:x1875323801078656:12345-192.168.206.21@tcp:101:bash.0 Request processed in 6722us (6999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.437868:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1788448456.439802:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6502:1875323826344704:192.168.206.21@tcp:105: 00010000:00010000:2.0:1788448456.439821:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448456.439863:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03b7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801078784:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2867us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448456.439872:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:3.0:1788448456.441719:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.441798:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801079040 00000100:00100000:2.0:1788448456.441806:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801079040 00000100:00100000:2.0:1788448456.441852:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:2.0:1788448456.441862:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11137:x1875323801079040:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:2.0:1788448456.442261:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11137:x1875323801079040:12345-192.168.206.21@tcp:35:bash.0 Request processed in 398us (547us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788448456.442269:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1788448456.574054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.574433:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801079296 00000100:00100000:1.0:1788448456.574443:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801079296 00000100:00100000:1.0:1788448456.574497:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1788448456.574504:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11147:x1875323801079296:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448456.574524:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.574540:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ac0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05ec expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448456.574632:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788448456.574704:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ac0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05ec expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.574715:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:1.0:1788448456.574717:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448456.574721:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ac0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05ec expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.574730:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:1.0:1788448456.574777:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11147:x1875323801079296:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 273us (731us total) trans 4294967315 rc 301/301 00000100:00100000:1.0:1788448456.574782:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1788448456.580372:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.580443:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801079552 00000100:00100000:2.0:1788448456.580464:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801079552 00000100:00100000:2.0:1788448456.580520:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1788448456.580539:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11147:x1875323801079552:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448456.580754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11147:x1875323801079552:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 219us (390us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788448456.580763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1788448456.643131:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.643249:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801079680 00000100:00100000:1.0:1788448456.643260:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801079680 00000100:00100000:1.0:1788448456.643340:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:1.0:1788448456.643351:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11153:x1875323801079680:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448456.643372:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.643391:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ace lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05f3 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.643453:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803ad5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.643468:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.643479:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448456.643515:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788448456.643519:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448456.643536:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.643560:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ace lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05f3 expref: 20 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.643577:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05f3 expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.643586:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448456.643589:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448456.643593:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030400, rc 0) 00000100:00100000:1.0:1788448456.643657:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11153:x1875323801079680:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 308us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.643668:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:3.0:1788448456.650980:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.651104:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801079936 00000100:00100000:1.0:1788448456.651112:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801079936 00000100:00100000:1.0:1788448456.651162:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:1.0:1788448456.651171:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11153:x1875323801079936:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448456.651188:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.651205:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803adc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e05fa expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.651319:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ae3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.651332:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.651342:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448456.651351:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788448456.651442:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803adc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05fa expref: 22 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.651458:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05fa expref: 21 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.651466:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:1.0:1788448456.651468:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448456.651471:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030e00, rc 0) 00000100:00100000:1.0:1788448456.651539:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:11153:x1875323801079936:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 368us (568us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788448456.651546:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448456.656197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.656287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.656360:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801080320 00000100:00100000:3.0:1788448456.656369:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801080320 00000100:00100000:3.0:1788448456.656433:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:3.0:1788448456.656444:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:2401:x1875323801080320:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448456.656458:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448456.656483:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ae3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05fa expref: 21 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.656500:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:3.0:1788448456.656505:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448456.656562:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:2401:x1875323801080320:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 120us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448456.656586:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1788448456.657839:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801080192 00000100:00100000:1.0:1788448456.657849:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801080192 00000100:00100000:1.0:1788448456.658074:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:1.0:1788448456.658084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11153:x1875323801080192:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448456.658121:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.658140:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803af1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0601 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.658248:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803af8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.658262:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803af8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.658273:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803af8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448456.658294:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788448456.658382:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803af1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0601 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.658399:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803af8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0601 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.658408:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:1.0:1788448456.658411:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788448456.658426:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031000, rc 0) 00000100:00100000:1.0:1788448456.658478:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11153:x1875323801080192:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 396us (2290us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788448456.658485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:2.0:1788448456.667349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.667521:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801080448 00000100:00100000:1.0:1788448456.667529:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801080448 00000100:00100000:1.0:1788448456.667578:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1788448456.667587:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801080448:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:1.0:1788448456.667625:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.667642:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.667651:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788448456.667655:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448456.667659:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.667688:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 7 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.667702:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 7 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448456.667715:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875323826344832:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448456.667788:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0341cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448456.669844:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875323826344832:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448456.669868:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448456.672783:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.673342:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801080576 00000100:00100000:1.0:1788448456.673352:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801080576 00002000:00100000:1.0:1788448456.673396:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9fc183ea8a80 x1875323801080576/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:692/0 lens 504/0 e 0 to 0 dl 1788448467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448456.673408:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc183ea8a80 with x1875323801080576 ext(0->12) 00010000:00010000:1.0:1788448456.673417:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 8 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.673431:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 8 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448456.673438:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc183ea8a80 00000100:00100000:1.0:1788448456.673462:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448456.673472:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801080576:12345-192.168.206.21@tcp:4:lfs.0 00000001:00100000:3.0:1788448456.675712:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000100:00100000:1.0:1788448456.676536:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801080576:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 3058us (3754us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788448456.676547:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00002000:00100000:1.0:1788448456.676559:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9fc183ea8a80 x1875323801080576/t4294967300(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:692/0 lens 504/448 e 0 to 0 dl 1788448467 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448456.676569:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc183ea8a80 with x1875323801080576 ext(0->12) 00010000:00010000:1.0:1788448456.676579:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.676596:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448456.676619:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc183ea8a80 00000100:00100000:1.0:1788448456.679229:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448456.679314:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801080704 00000100:00100000:0.0:1788448456.679322:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801080704 00010000:00010000:0.0:1788448456.679355:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448456.679391:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:0.0:1788448456.679399:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801080704:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448456.679411:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788448456.679426:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788448456.679428:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788448456 00002000:00010000:0.0:1788448456.679430:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788448456 00002000:00010000:0.0:1788448456.679433:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788448456 00002000:00010000:0.0:1788448456.679435:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788448456.679440:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.679452:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.679474:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a96b40af/0xf45a9e4e6b803ab9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05e5 expref: 9 pid: 8431 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.679489:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448456.679493:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448456.679499:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.679524:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.679554:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448456.679598:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801080704:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 199us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448456.679605:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00010000:00010000:1.0:1788448456.679657:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679666:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679683:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679691:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679698:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679705:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448456.679709:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679718:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679729:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.679742:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803b06 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448456.679779:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801080448:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 12193us (12438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.679786:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:0.0:1788448456.682247:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.682411:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801080960 00000100:00100000:2.0:1788448456.682420:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801080960 00000100:00100000:2.0:1788448456.682471:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:2.0:1788448456.682480:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11153:x1875323801080960:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:2.0:1788448456.682533:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803af8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0601 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448456.682749:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788448456.682793:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788448456.683084:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788448456.683237:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.683249:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 26 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.683257:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.683368:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 26 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.683382:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 26 pid: 9023 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448456.683395:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875323826344960:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448456.683548:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448456.687195:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448456.687573:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875323826344960:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448456.687607:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448456.687653:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801081088 00000100:00100000:3.0:1788448456.687660:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801081088 00010000:00010000:3.0:1788448456.687694:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 27 pid: 9023 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448456.687765:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1788448456.687775:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:2399:x1875323801081088:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448456.687788:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448456.687795:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 27 pid: 9023 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.687808:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 27 pid: 9023 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.687828:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803a9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d7 expref: 27 pid: 9023 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.687842:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:3.0:1788448456.687847:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.687856:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.687863:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.687936:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448456.687985:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+26:2399:x1875323801081088:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 211us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448456.687991:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00010000:00010000:0.0:1788448456.688047:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.688054:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448456.688168:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788448456.688274:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788448456.688361:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e65c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826345088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788448456.688404:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448456.688430:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c12923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448456.688446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826345088 00000100:00100000:0.0:1788448456.688450:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826345088 00000100:00100000:0.0:1788448456.688536:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788448456.688542:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875323826345088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788448456.688616:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875323826345088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 74us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448456.688622:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:0.0:1788448456.688642:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448456.688661:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e65c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826345088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788448456.688785:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1788448456.688821:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e65c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826345216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788448456.688848:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448456.688863:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448456.688914:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826345216 00000100:00100000:2.0:1788448456.688919:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826345216 00000100:00100000:2.0:1788448456.689064:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788448456.689074:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875323826345216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788448456.689172:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1875323826345216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 100us (323us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788448456.689189:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788448456.690040:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e65c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826345216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788448456.690149:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1788448456.690189:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.690198:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.690206:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.690221:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.690225:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.690232:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.690245:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:0.0:1788448456.690248:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788448456.690260:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.690266:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803b0d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448456.690742:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788448456.690796:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788448456.690806:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374035924281ns, next at 375035922423ns, rc = 0 00000001:00080000:0.0:1788448456.690812:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1788448456.690836:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb7b4600) 00010000:00010000:0.0:1788448456.690839:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788448456.690846:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803af8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0601 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448456.691180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:11153:x1875323801080960:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 8699us (8938us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788448456.691189:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000020:00080000:0.0:1788448456.691193:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788448456.694080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.694253:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801081216 00000100:00100000:1.0:1788448456.694263:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801081216 00000100:00100000:1.0:1788448456.694444:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:1.0:1788448456.694456:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:11153:x1875323801081216:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448456.694478:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448456.694500:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803b14 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0608 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.694553:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803b14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0608 expref: 30 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.694566:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803b14 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0608 expref: 30 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448456.694582:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448456.694585:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448456.694588:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:1.0:1788448456.694644:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11153:x1875323801081216:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 191us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.694665:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1788448456.697433:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.697571:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801081472 00000100:00100000:3.0:1788448456.697579:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801081472 00000100:00100000:3.0:1788448456.697630:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1788448456.697640:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11153:x1875323801081472:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448456.697834:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+31:11153:x1875323801081472:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 195us (408us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788448456.697841:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00010000:00010000:3.0:1788448456.702221:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448456.787675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448456.787778:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801081728 00000100:00100000:1.0:1788448456.787787:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801081728 00000100:00100000:1.0:1788448456.787842:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1788448456.787852:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+31:11163:x1875323801081728:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448456.787875:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448456.788195:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803b1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e060f expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448456.788308:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788448456.788400:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803b1b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e060f expref: 33 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.788414:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:3.0:1788448456.788417:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448456.788422:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803b1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e060f expref: 33 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448456.788435:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e000, rc 0) 00000100:00100000:3.0:1788448456.788493:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11163:x1875323801081728:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 642us (827us total) trans 4294967329 rc 301/301 00000100:00100000:3.0:1788448456.788512:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:2.0:1788448456.792369:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448456.792451:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801081856 00000100:00100000:0.0:1788448456.792460:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801081856 00000100:00100000:0.0:1788448456.792512:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1788448456.792520:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11163:x1875323801081856:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:0.0:1788448456.792584:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792599:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792609:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792632:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792639:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792646:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792720:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792727:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792733:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448456.792779:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792790:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792795:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792801:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792806:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.792810:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792823:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792833:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448456.792836:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.792840:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792846:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792858:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792863:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792868:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792873:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.792875:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792927:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792934:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:0.0:1788448456.792937:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.792939:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792954:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792963:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792969:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792974:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792978:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.792981:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792986:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.792993:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:0.0:1788448456.792995:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.792998:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.793004:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803b37 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448456.793066:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11163:x1875323801081856:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 546us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448456.793073:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:2.0:1788448456.799801:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448456.799924:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801082112 00000100:00100000:3.0:1788448456.799933:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801082112 00000100:00100000:3.0:1788448456.799989:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448456.800000:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11163:x1875323801082112:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448456.800208:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+33:11163:x1875323801082112:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 209us (414us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788448456.800228:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000040:00080000:3.0:1788448456.832797:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788448456.833697:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448456.840158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448456.840357:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801082368 00000100:00100000:0.0:1788448456.840367:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801082368 00000100:00100000:0.0:1788448456.840426:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1788448456.840435:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+33:11166:x1875323801082368:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448456.840456:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448456.840474:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b3e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0616 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840539:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840552:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840562:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840573:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840581:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840587:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840678:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840688:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840709:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448456.840719:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788448456.840786:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840794:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840800:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840806:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.840810:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840817:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840828:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448456.840831:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.840836:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840842:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803b45 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840855:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840859:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840872:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.840878:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448456.841490:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.841498:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.841508:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:0.0:1788448456.841510:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448456.841513:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.841520:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b4c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.841556:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b3e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.841567:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448456.841574:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:0.0:1788448456.841576:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448456.841579:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ec00, rc 0) 00000100:00100000:0.0:1788448456.841635:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11166:x1875323801082368:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1202us (1543us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1788448456.841651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1788448456.844498:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448456.844571:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801082496 00000100:00100000:2.0:1788448456.844580:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801082496 00000100:00100000:2.0:1788448456.844628:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1788448456.844638:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11166:x1875323801082496:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1788448456.844695:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844710:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844719:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844748:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844755:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844762:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844767:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448456.844785:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844791:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844804:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448456.844806:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448456.844810:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448456.844816:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b61 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448456.844907:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11166:x1875323801082496:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 244us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448456.844923:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:3.0:1788448456.847489:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448456.847567:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801082752 00000100:00100000:0.0:1788448456.847575:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801082752 00000100:00100000:0.0:1788448456.847625:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448456.847635:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11166:x1875323801082752:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448456.847838:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+36:11166:x1875323801082752:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 204us (355us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788448456.847846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1788448457.159401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448457.159507:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801083008 00000100:00100000:0.0:1788448457.159516:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801083008 00000100:00100000:0.0:1788448457.159575:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1788448457.159585:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+36:11197:x1875323801083008:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:0.0:1788448457.159607:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448457.159626:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e061d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.159724:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.159738:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.159749:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448457.159760:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788448457.159931:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803b68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e061d expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.159949:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e061d expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.159957:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:0.0:1788448457.159961:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448457.159964:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e200, rc 0) 00000100:00100000:0.0:1788448457.160021:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11197:x1875323801083008:12345-192.168.206.21@tcp:101:cat.0 Request processed in 436us (630us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788448457.160028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:1.0:1788448457.164262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448457.164435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801083264 00000100:00100000:0.0:1788448457.164445:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801083264 00000100:00100000:0.0:1788448457.164501:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1788448457.164512:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11197:x1875323801083264:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:0.0:1788448457.164713:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:11197:x1875323801083264:12345-192.168.206.21@tcp:35:cat.0 Request processed in 202us (461us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1788448457.164720:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1788448457.171432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448457.171523:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801083392 00000100:00100000:0.0:1788448457.171532:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801083392 00000100:00100000:0.0:1788448457.171592:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:0.0:1788448457.171602:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:2398:x1875323801083392:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448457.171616:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448457.171639:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803b6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e061d expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.171686:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:0.0:1788448457.171691:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448457.171748:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:2398:x1875323801083392:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 147us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448457.171756:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:1.0:1788448457.286766:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448457.288344:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801083648 00000100:00100000:3.0:1788448457.288372:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801083648 00000100:00100000:3.0:1788448457.288436:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:3.0:1788448457.288447:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11203:x1875323801083648:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788448457.288469:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448457.288472:0:13811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788448457.288495:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803ad5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05f3 expref: 38 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.288513:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448457.288518:0:13811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448457.288530:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803b7d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0624 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.288621:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.288645:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.288668:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.289014:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 38 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.289028:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 38 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448457.289042:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083c69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826345344:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448457.289610:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448457.301502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448457.302344:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083c69f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826345344:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448457.302381:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448457.303452:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801083776 00000100:00100000:2.0:1788448457.303461:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801083776 00010000:00010000:2.0:1788448457.303495:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 39 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448457.303532:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:2.0:1788448457.303540:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:2398:x1875323801083776:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448457.303552:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448457.303558:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 39 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.303569:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 39 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.303607:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803b53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0616 expref: 39 pid: 6519 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.303622:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448457.303626:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.303635:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.303642:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.303668:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448457.303717:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:2398:x1875323801083776:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 178us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448457.303725:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00010000:00010000:1.0:1788448457.303832:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.303840:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448457.303856:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788448457.304014:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803b7d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 39 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.304028:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 38 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.304036:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448457.304038:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448457.304041:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:1.0:1788448457.304062:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11203:x1875323801083648:12345-192.168.206.21@tcp:101:dd.0 Request processed in 15618us (17306us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788448457.304077:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:0.0:1788448457.311737:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448457.311826:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801083904 00000100:00100000:2.0:1788448457.311835:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801083904 00000100:00100000:2.0:1788448457.311998:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:2.0:1788448457.312009:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11203:x1875323801083904:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788448457.312031:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448457.312049:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e062b expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.312078:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.312429:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.312439:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.312546:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803b92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 40 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.312563:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 39 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448457.312570:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448457.312573:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448457.312576:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331200, rc 0) 00000100:00100000:2.0:1788448457.313848:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:11203:x1875323801083904:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1834us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448457.313858:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:0.0:1788448457.319923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448457.320050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801084160 00000100:00100000:3.0:1788448457.320059:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801084160 00000100:00100000:3.0:1788448457.320121:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1788448457.320132:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:11203:x1875323801084160:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:3.0:1788448457.320369:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.320386:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.320414:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448457.320458:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1788448457.320838:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ace22c16 reply state 00000000a5880c58 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.320850:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448457.320857:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:3.0:1788448457.320860:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448457.320864:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448457.320979:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+42:11203:x1875323801084160:12345-192.168.206.21@tcp:36:dd.0 Request processed in 848us (1062us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788448457.320986:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000020:00080000:3.0:1788448457.320991:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788448457.408045:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826345600:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448457.408119:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448457.408184:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448457.408191:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826345472:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448457.408227:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448457.408259:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826345472 00000100:00100000:2.0:1788448457.408265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826345472 00000100:00100000:2.0:1788448457.408304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788448457.408313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826345472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448457.408369:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448457.408412:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826345472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448457.408419:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788448457.408458:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826345472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448457.408599:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826345600 00000100:00100000:1.0:1788448457.408604:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826345600 00000100:00100000:1.0:1788448457.408643:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788448457.408650:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826345600:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448457.408666:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448457.408699:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826345600:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448457.408705:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788448457.408857:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448457.408867:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826345728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448457.408926:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448457.408954:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826345728 00000100:00100000:0.0:1788448457.408958:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826345728 00000100:00100000:0.0:1788448457.408985:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788448457.408992:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826345728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448457.409002:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448457.409031:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826345728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448457.409037:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788448457.409068:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826345728:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788448457.409252:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448457.409275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826345600:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448457.689538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448457.689637:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801084288 00000100:00100000:0.0:1788448457.689647:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801084288 00000100:00100000:0.0:1788448457.689721:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:0.0:1788448457.689732:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+42:11217:x1875323801084288:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:0.0:1788448457.689754:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448457.689784:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803ba7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0632 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.689844:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.689857:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.689870:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.689912:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.689921:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.689927:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.690010:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.690021:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 43 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.690028:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.690058:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 43 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.690082:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 43 pid: 13811 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448457.690096:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826345856:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448457.690202:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1292900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448457.694006:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448457.694231:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801084544 00000100:00100000:3.0:1788448457.694240:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801084544 00000100:00100000:3.0:1788448457.694288:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:3.0:1788448457.694297:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:6168:x1875323801084544:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788448457.694554:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+45:6168:x1875323801084544:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 257us (555us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788448457.694562:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1788448457.694859:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826345856:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448457.694901:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448457.698187:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448457.698339:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801084672 00000100:00100000:0.0:1788448457.698360:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801084672 00010000:00010000:0.0:1788448457.698400:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 45 pid: 13811 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448457.698438:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1788448457.698449:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+45:2399:x1875323801084672:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448457.698462:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448457.698469:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 45 pid: 13811 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.698483:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 45 pid: 13811 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.698505:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803b84 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0624 expref: 45 pid: 13811 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.698520:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:0.0:1788448457.698525:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.698548:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.698556:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448457.698586:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448457.698638:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:2399:x1875323801084672:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 191us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448457.698645:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00010000:00010000:1.0:1788448457.698928:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.698937:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448457.698986:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788448457.698991:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448457.699027:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699040:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699049:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699061:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699067:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699073:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448457.699076:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699084:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699093:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448457.699096:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448457.699100:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699106:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803bae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699117:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699123:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699128:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699134:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448457.699141:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699147:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699154:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:1.0:1788448457.699157:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448457.699159:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699165:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803bb5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699216:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803ba7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0632 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699231:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0632 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.699239:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448457.699242:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448457.699245:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:1.0:1788448457.699277:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:11217:x1875323801084288:12345-192.168.206.21@tcp:101:stat.0 Request processed in 9547us (9749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448457.699285:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00010000:00010000:2.0:1788448457.726668:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448457.796301:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448457.796399:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801084928 00000100:00100000:1.0:1788448457.796409:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801084928 00000100:00100000:1.0:1788448457.796473:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1788448457.796483:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:11223:x1875323801084928:12345-192.168.206.21@tcp:36:truncate.0 00010000:00010000:1.0:1788448457.796555:0:9023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448457.796583:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803bbc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0632 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.796602:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448457.796606:0:9023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448457.797497:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.797516:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.797526:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448457.797571:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788448457.797595:0:9023:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a570ad10 reply state 000000009710e560 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.797608:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448457.797615:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448457.797617:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448457.797621:0:9023:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448457.797840:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+45:11223:x1875323801084928:12345-192.168.206.21@tcp:36:truncate.0 Request processed in 1356us (1544us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788448457.797849:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000020:00080000:1.0:1788448457.797854:0:9023:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788448458.006874:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.006988:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801085056 00000100:00100000:1.0:1788448458.007009:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801085056 00000100:00100000:1.0:1788448458.007080:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:1.0:1788448458.007090:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+45:11237:x1875323801085056:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:1.0:1788448458.007112:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.007132:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803bca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0639 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007191:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007214:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007225:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007237:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007245:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007253:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007324:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007333:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007339:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448458.007385:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788448458.007389:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448458.007408:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007420:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007428:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007433:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007439:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007444:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.007448:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007454:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007465:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448458.007468:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.007472:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007477:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803bd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007501:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007507:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007512:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007517:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.007520:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007526:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007534:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:1.0:1788448458.007536:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.007539:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007544:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bd8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007568:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803bca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 47 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007581:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 46 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.007598:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.007600:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448458.007602:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031e00, rc 0) 00000100:00100000:1.0:1788448458.007666:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+46:11237:x1875323801085056:12345-192.168.206.21@tcp:101:stat.0 Request processed in 576us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448458.007673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00080000:2.0:1788448458.007743:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448458.118485:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.118600:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801085312 00000100:00100000:1.0:1788448458.118612:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801085312 00000100:00100000:1.0:1788448458.118688:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:1.0:1788448458.118700:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+46:11247:x1875323801085312:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448458.118727:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.118753:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0640 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448458.118962:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788448458.119076:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803be6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0640 expref: 48 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.119104:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:1.0:1788448458.119107:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448458.119113:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0640 expref: 48 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.119130:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030400, rc 0) 00000100:00100000:1.0:1788448458.119190:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:11247:x1875323801085312:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 492us (719us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1788448458.119219:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1788448458.124147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.124510:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801085568 00000100:00100000:3.0:1788448458.124523:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801085568 00000100:00100000:3.0:1788448458.124599:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:3.0:1788448458.124628:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:11247:x1875323801085568:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448458.125163:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+48:11247:x1875323801085568:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 535us (1027us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1788448458.125174:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1788448458.170700:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.170811:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801085824 00000100:00100000:3.0:1788448458.170825:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801085824 00000100:00100000:1.0:1788448458.170946:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:1.0:1788448458.170961:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+48:11253:x1875323801085824:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448458.170994:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.171019:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803bf4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0647 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.171168:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.171186:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.171198:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.171250:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 49 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.171266:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 49 pid: 6517 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448458.171292:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826345984:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448458.171546:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b03416c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448458.176039:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.176671:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801085952 00000100:00100000:2.0:1788448458.176685:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801085952 00010000:00010000:2.0:1788448458.176740:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 50 pid: 6517 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448458.176799:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:2.0:1788448458.176811:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:2399:x1875323801085952:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448458.176830:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448458.176839:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 50 pid: 6517 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.176854:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 50 pid: 6517 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.176931:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448458.176936:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.176947:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.176955:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.176975:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448458.177045:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:2399:x1875323801085952:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 236us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448458.177053:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00010000:00010000:1.0:1788448458.177266:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803bdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0639 expref: 49 pid: 6517 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448458.177302:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826345984:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448458.177330:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.177341:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.177348:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448458.177369:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788448458.177536:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803bf4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 50 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.177554:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 49 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.177562:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.177565:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448458.177567:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031600, rc 0) 00000100:00100000:1.0:1788448458.177600:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+49:11253:x1875323801085824:12345-192.168.206.21@tcp:101:bash.0 Request processed in 6643us (6914us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788448458.177608:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:0.0:1788448458.182379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.183248:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801086208 00000100:00100000:3.0:1788448458.183262:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801086208 00000100:00100000:3.0:1788448458.183450:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:3.0:1788448458.183462:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+49:11253:x1875323801086208:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:3.0:1788448458.183940:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.184034:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.184049:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448458.184106:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1788448458.184133:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004983dfa5 reply state 0000000004ffdf41 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.184147:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.184156:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:3.0:1788448458.184160:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448458.184164:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448458.184447:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:11253:x1875323801086208:12345-192.168.206.21@tcp:36:bash.0 Request processed in 983us (2078us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1788448458.184465:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000020:00080000:3.0:1788448458.184471:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788448458.195584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.195705:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801086336 00000100:00100000:1.0:1788448458.195718:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801086336 00000100:00100000:1.0:1788448458.195929:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:1.0:1788448458.195954:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:11253:x1875323801086336:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448458.196001:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.196027:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803c10 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e064e expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.196156:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.196174:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 53 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.196183:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.196236:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 53 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.196252:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 53 pid: 9023 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448458.196268:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826346112:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448458.196386:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b03416c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448458.199309:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394e680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826346112:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448458.199346:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448458.200262:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.200532:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801086464 00000100:00100000:1.0:1788448458.200543:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801086464 00010000:00010000:1.0:1788448458.200670:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 54 pid: 9023 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448458.200998:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:1.0:1788448458.201011:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:2398:x1875323801086464:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448458.201032:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448458.201041:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 54 pid: 9023 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.201057:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 54 pid: 9023 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.201083:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803bfb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0647 expref: 54 pid: 9023 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.201104:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.201109:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.201121:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.201130:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.201164:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448458.201242:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:2398:x1875323801086464:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 233us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448458.201250:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00010000:00010000:3.0:1788448458.201317:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.201326:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448458.201393:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788448458.201398:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448458.201421:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.201459:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803c10 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e064e expref: 53 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.201477:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e064e expref: 52 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.201486:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:3.0:1788448458.201489:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448458.201491:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031e00, rc 0) 00000100:00100000:3.0:1788448458.201523:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:11253:x1875323801086336:12345-192.168.206.21@tcp:101:bash.0 Request processed in 5583us (5956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448458.201530:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:0.0:1788448458.209247:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.209407:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801086720 00000100:00100000:2.0:1788448458.209421:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801086720 00000100:00100000:2.0:1788448458.209489:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1788448458.209498:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:11253:x1875323801086720:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:2.0:1788448458.209747:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:11253:x1875323801086720:12345-192.168.206.21@tcp:35:bash.0 Request processed in 248us (513us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788448458.209763:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:0.0:1788448458.317183:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.318742:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801086976 00000100:00100000:3.0:1788448458.318836:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801086976 00000100:00100000:3.0:1788448458.319047:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:3.0:1788448458.319062:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:11263:x1875323801086976:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448458.319110:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448458.319138:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0655 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448458.319678:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788448458.320442:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0655 expref: 55 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.320464:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:3.0:1788448458.320468:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448458.320475:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0655 expref: 55 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.320494:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448458.320580:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11263:x1875323801086976:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1521us (3410us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1788448458.320589:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:0.0:1788448458.323795:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.324007:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801087104 00000100:00100000:1.0:1788448458.324034:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801087104 00000100:00100000:1.0:1788448458.324099:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:1.0:1788448458.324111:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11263:x1875323801087104:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:1.0:1788448458.324570:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324591:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324604:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324619:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324626:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324632:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324721:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324732:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324738:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448458.324797:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324824:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324830:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324838:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324843:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.324848:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324856:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.324868:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448458.325599:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.325608:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325616:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c2c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325635:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325642:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325648:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325662:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.325666:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325672:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325681:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:1.0:1788448458.325684:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.325687:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325693:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325703:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325708:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325714:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325719:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.325722:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325727:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325742:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.325744:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.325747:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.325752:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448458.326021:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11263:x1875323801087104:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 1908us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448458.326032:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00000001:00080000:2.0:1788448458.328349:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00010000:00010000:1.0:1788448458.328395:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328409:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328418:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328425:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.328430:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328438:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328471:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9fc1bb42bb00) 00010000:00010000:1.0:1788448458.328476:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.328501:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448458.328503:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:1.0:1788448458.328508:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b803a50 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788448458.328521:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc1c12923c0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788448458.328525:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc08227bf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1c1292240 00000020:00080000:2.0:1788448458.328529:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc191e3ca00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1bb787e00 00010000:00010000:1.0:1788448458.328533:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328539:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328545:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328550:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.328553:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328559:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328566:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448458.328569:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.328572:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328577:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b803a57 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328592:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328598:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328608:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328612:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.328615:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328621:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328628:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4c00) 00010000:00010000:1.0:1788448458.328630:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.328632:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328637:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803a96 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328653:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328659:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328664:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328668:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.328670:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328684:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328692:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.328694:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.328697:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448458.328700:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:1.0:1788448458.328703:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803ba0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328713:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448458.328719:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826346240:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788448458.328719:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328725:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328729:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.328732:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328737:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328743:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.328745:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.328747:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328762:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803bc3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328776:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328781:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328787:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328792:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.328795:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328801:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328809:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.328811:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.328814:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.328820:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803c09 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448458.328845:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1788448458.328984:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448458.329061:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826346240 00000100:00100000:2.0:1788448458.329071:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826346240 00000020:00080000:1.0:1788448458.329249:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788448458.329612:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448458.329624:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826346240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788448458.329657:0:8539:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788448458.329696:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a998ec8, atime: 0x6a998ec8, ctime: 0x6a998ec8, blocks: 0x8 00010000:00010000:2.0:1788448458.329705:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.329722:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=375s v=(0 0) 00010000:00010000:2.0:1788448458.329727:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448458.329734:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.330049:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.330062:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788448458.330069:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788448458.330071:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.330167:0:8539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448458.330397:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788448458.330398:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826346240:12345-0@lo:6:osp-syn-1-0.0 Request processed in 775us (1414us total) trans 4294967302 rc 0/0 00010000:00010000:1.0:1788448458.330412:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448458.330418:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1788448458.330420:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448458.330424:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.330432:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.330448:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.330469:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b803c41 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.330490:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448458.330491:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448458.330493:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788448458.330558:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc191317100/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788448458.330567:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191317100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826346240:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788448458.333628:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.333734:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801087360 00000100:00100000:2.0:1788448458.333745:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801087360 00000100:00100000:2.0:1788448458.334036:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448458.334050:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:11263:x1875323801087360:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448458.334510:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:11263:x1875323801087360:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 461us (893us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788448458.334519:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1788448458.375023:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.375194:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801087616 00000100:00100000:1.0:1788448458.375217:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801087616 00000100:00100000:1.0:1788448458.375419:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:1.0:1788448458.375432:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:11266:x1875323801087616:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448458.375463:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.375489:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803c48 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e065c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375582:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375614:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375628:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375645:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375651:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375658:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375803:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375813:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375821:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448458.375831:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788448458.375945:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375954:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375962:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375974:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.375979:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.375987:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376001:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448458.376004:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.376009:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376015:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b803c4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376029:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376035:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376042:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376047:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.376050:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376055:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376070:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc08319c800) 00010000:00010000:1.0:1788448458.376073:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448458.376075:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376194:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803c56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376252:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803c48 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e065c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376267:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e065c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.376275:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.376346:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448458.376349:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031600, rc 0) 00000100:00100000:1.0:1788448458.376958:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11266:x1875323801087616:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1525us (2075us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1788448458.376969:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:0.0:1788448458.380777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.380836:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.381192:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801087744 00000100:00100000:2.0:1788448458.381220:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801087744 00000100:00100000:2.0:1788448458.381316:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:2.0:1788448458.381330:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11266:x1875323801087744:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1788448458.381850:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.381872:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.381972:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382019:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382027:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382033:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382059:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448458.382065:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382072:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382144:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448458.382147:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448458.382153:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.382159:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803c6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448458.382567:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801087872 00000100:00100000:3.0:1788448458.382574:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801087872 00000100:00100000:3.0:1788448458.382641:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1788448458.382652:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:2400:x1875323801087872:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448458.382667:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448458.382687:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803c5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e065c expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.382716:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:3.0:1788448458.382720:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448458.382779:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:2400:x1875323801087872:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 129us (1941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448458.382787:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:2.0:1788448458.384097:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:11266:x1875323801087744:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 2759us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448458.384111:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:0.0:1788448458.385659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.385748:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801088128 00000100:00100000:3.0:1788448458.385759:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801088128 00000100:00100000:3.0:1788448458.386541:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1788448458.386555:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:11266:x1875323801088128:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448458.386836:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11266:x1875323801088128:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 283us (1186us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788448458.386845:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1788448458.562365:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.562477:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801088384 00000100:00100000:3.0:1788448458.562489:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801088384 00000100:00100000:3.0:1788448458.562973:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:3.0:1788448458.562988:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11284:x1875323801088384:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:3.0:1788448458.563020:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448458.563047:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c72 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0663 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.563187:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803c79 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.563215:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803c79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.563251:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803c79 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448458.563268:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788448458.563406:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c72 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0663 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.563428:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803c79 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0663 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.563439:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:3.0:1788448458.563442:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788448458.563446:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f200, rc 0) 00000100:00100000:2.0:1788448458.565156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11284:x1875323801088384:12345-192.168.206.21@tcp:101:cat.0 Request processed in 2156us (2789us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788448458.565172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:1.0:1788448458.613780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.614414:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801088512 00000100:00100000:3.0:1788448458.614427:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801088512 00000100:00100000:3.0:1788448458.614515:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:3.0:1788448458.614527:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11285:x1875323801088512:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448458.614559:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448458.614586:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e066a expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.614675:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803c8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.614692:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.614705:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448458.614791:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788448458.614795:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448458.614819:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803c8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.614852:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803c87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e066a expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.614874:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803c8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e066a expref: 18 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.614942:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448458.614946:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448458.614950:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:3.0:1788448458.615032:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11285:x1875323801088512:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 506us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448458.615040:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:3.0:1788448458.625544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.625746:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801088896 00000100:00100000:0.0:1788448458.625759:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801088896 00000100:00100000:0.0:1788448458.625833:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1788448458.625864:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11285:x1875323801088896:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448458.626296:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11285:x1875323801088896:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 433us (764us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788448458.626306:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1788448458.628554:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.629006:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089024 00000100:00100000:0.0:1788448458.629019:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089024 00000100:00100000:0.0:1788448458.629429:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:0.0:1788448458.629444:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11285:x1875323801089024:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:0.0:1788448458.629476:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788448458.629509:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803c17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e064e expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.629541:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803c79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0663 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.629559:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803b14 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0608 expref: 17 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.629571:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:0.0:1788448458.629577:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448458.629650:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11285:x1875323801089024:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 209us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448458.629659:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1788448458.635021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.637521:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089152 00000100:00100000:0.0:1788448458.637542:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089152 00000100:00100000:0.0:1788448458.637626:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:0.0:1788448458.637637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11285:x1875323801089152:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:0.0:1788448458.638056:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.638602:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.638621:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448458.640654:0:6519:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448458.641155:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788448458.641261:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788448458.641418:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11285:x1875323801089152:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 3774us (6406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448458.641433:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1788448458.660070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.660280:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089280 00000100:00100000:2.0:1788448458.660294:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089280 00000100:00100000:2.0:1788448458.660370:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:2.0:1788448458.660383:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11287:x1875323801089280:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448458.660410:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448458.660436:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803c9c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0671 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660546:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660564:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660580:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660598:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660605:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660611:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660704:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660713:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.660720:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448458.661140:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788448458.661146:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448458.661171:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661212:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661222:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661229:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661236:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661242:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448458.661247:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661255:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661270:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448458.661274:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448458.661278:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661284:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ca3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661299:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661305:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661416:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661421:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448458.661424:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661430:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661438:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb7b4300) 00010000:00010000:2.0:1788448458.661440:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448458.661443:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661448:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803caa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661491:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803c9c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 18 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661506:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.661514:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448458.661516:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448458.661519:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330a00, rc 0) 00000100:00100000:2.0:1788448458.661716:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11287:x1875323801089280:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1333us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448458.661745:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00010000:00010000:3.0:1788448458.751994:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448458.878701:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448458.878713:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448458.878758:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788448458.878771:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448458.878978:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186266a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826346368:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448458.879109:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448458.884452:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186266a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826346368:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448458.885571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.885660:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089408 00000100:00100000:0.0:1788448458.885669:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089408 00000100:00100000:0.0:1788448458.885738:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:0.0:1788448458.885750:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11298:x1875323801089408:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448458.885791:0:13811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448458.885970:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11298:x1875323801089408:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 221us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448458.885986:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:3.0:1788448458.896115:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.896244:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089536 00000100:00100000:2.0:1788448458.896256:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089536 00000100:00100000:2.0:1788448458.896340:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:2.0:1788448458.896352:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11298:x1875323801089536:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788448458.896447:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896467:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896482:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896499:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896506:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896514:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896548:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896559:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896565:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448458.896641:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788448458.896646:0:13810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448458.896659:0:13810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896672:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896679:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896685:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896691:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448458.896696:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896704:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896718:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:2.0:1788448458.896722:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448458.896727:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896733:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803cb8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896749:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896765:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896772:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896777:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448458.896781:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896787:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896796:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9fc1bb7b4300) 00010000:00010000:2.0:1788448458.896800:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448458.896802:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896808:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803cbf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896823:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896830:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896836:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896840:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448458.896850:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896857:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896865:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448458.896868:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448458.896871:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448458.896877:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803cc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448458.897006:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11298:x1875323801089536:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 655us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448458.897015:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:2.0:1788448458.899614:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.899706:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089792 00000100:00100000:1.0:1788448458.899727:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089792 00000100:00100000:1.0:1788448458.899796:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:1.0:1788448458.899808:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11298:x1875323801089792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448458.899832:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.899874:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ccd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0678 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.900779:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.900799:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.900813:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448458.900827:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788448458.901169:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901178:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901185:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901192:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448458.901197:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901217:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901232:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448458.901235:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448458.901241:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901265:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803cd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901369:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ccd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0678 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901380:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:1.0:1788448458.901382:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448458.901386:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803ccd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0678 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.901395:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:1.0:1788448458.901539:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801089792:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1732us (1940us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788448458.901549:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1788448458.908603:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.908658:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801089920 00000100:00100000:3.0:1788448458.908671:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801089920 00000100:00100000:3.0:1788448458.908738:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:3.0:1788448458.908750:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0823f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801089920:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788448458.908822:0:13811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788448458.909611:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0823f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801089920:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 857us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448458.909622:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:1.0:1788448458.915592:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.915641:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801090176 00000100:00100000:1.0:1788448458.915652:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801090176 00000100:00100000:1.0:1788448458.915716:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:1.0:1788448458.915730:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801090176:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448458.915757:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.915761:0:13810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788448458.915795:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803c8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e066a expref: 18 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.915818:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448458.915836:0:13810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448458.915855:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ce2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e067f expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448458.920044:0:13810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788448458.920317:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803ce9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.920337:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.920351:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.920436:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803ce2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e067f expref: 20 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.920457:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e067f expref: 19 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.920467:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc08319c800) 00010000:00010000:1.0:1788448458.920470:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448458.920474:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030a00, rc 0) 00000100:00100000:1.0:1788448458.920567:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11298:x1875323801090176:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 4838us (4990us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788448458.920578:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:2.0:1788448458.926722:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.926809:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801090432 00000100:00100000:0.0:1788448458.926822:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801090432 00000100:00100000:0.0:1788448458.926990:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:0.0:1788448458.927003:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11298:x1875323801090432:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448458.927150:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448458.927185:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b803ce9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e067f expref: 19 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.927218:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc08319c800) 00010000:00010000:0.0:1788448458.927231:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448458.927262:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928005:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928023:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928045:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928052:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928059:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928258:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928267:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928274:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928454:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448458.928460:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928468:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928482:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448458.928485:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448458.928491:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928498:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803cf7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928512:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928518:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928524:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928537:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448458.928540:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928547:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928556:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x4bc6af5e (ffff9fc08336a600) 00010000:00010000:0.0:1788448458.928558:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448458.928561:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.928568:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803cfe lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x4bc6af5e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448458.928734:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801090432:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1729us (2024us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448458.928744:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:0.0:1788448458.936268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.936514:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801090560 00000100:00100000:3.0:1788448458.936528:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801090560 00000100:00100000:3.0:1788448458.936606:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:3.0:1788448458.936619:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801090560:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448458.936644:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448458.936673:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d05 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0686 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.936719:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.936734:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.936747:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.936935:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d05 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 20 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.936951:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.936961:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:3.0:1788448458.936971:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448458.936976:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:3.0:1788448458.937056:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11298:x1875323801090560:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 439us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448458.937064:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:1.0:1788448458.940573:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.941095:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801090816 00000100:00100000:3.0:1788448458.941108:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801090816 00000100:00100000:3.0:1788448458.941179:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:3.0:1788448458.941191:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11298:x1875323801090816:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788448458.941312:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.941334:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.941347:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448458.941577:0:13810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788448458.941590:0:13810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376286707288ns, next at 377286703275ns, rc = 0 00000004:00010000:3.0:1788448458.941651:0:13810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b751da6b reply state 000000004cf6f8d0 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.941667:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.941675:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:3.0:1788448458.941678:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788448458.941682:0:13810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448458.941806:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:11298:x1875323801090816:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 615us (1246us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788448458.941832:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:2.0:1788448458.945625:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.946006:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801090944 00000100:00100000:3.0:1788448458.946020:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801090944 00000100:00100000:3.0:1788448458.946105:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:3.0:1788448458.946119:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:11298:x1875323801090944:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448458.946150:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448458.946174:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e068d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.946257:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.946274:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448458.946296:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:3.0:1788448458.946299:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448458.946303:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448458.946373:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11298:x1875323801090944:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 257us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448458.946381:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:0.0:1788448458.949515:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.949652:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801091072 00000100:00100000:3.0:1788448458.949665:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801091072 00000100:00100000:3.0:1788448458.949719:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1788448458.949729:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875323801091072:12345-192.168.206.21@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788448458.949771:0:8433:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp t0 exp 0000000000000000 cur 376 last 0 00000020:00000080:3.0:1788448458.949821:0:8433:0:(genops.c:1385:class_connect()) connect: client 5f39813a-d0bd-49ee-95eb-2130028b48f0, cookie 0xf45a9e4e6b803d21 00002000:00100000:3.0:1788448458.949836:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5f39813a-d0bd-49ee-95eb-2130028b48f0/ffff9fc1bf857800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788448458.949856:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788448458.950311:0:8433:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788448458.950350:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9fc199804800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448458.950438:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2397:x1875323801091072:12345-192.168.206.21@tcp:8:lhsmtool_posix.0 Request processed in 706us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448458.950449:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:1.0:1788448458.953074:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448458.953182:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801091200 00000100:00100000:3.0:1788448458.953194:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801091200 00000100:00100000:3.0:1788448458.953290:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:3.0:1788448458.953304:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:0:x1875323801091200:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788448458.953624:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788448458.966860:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788448458.966924:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000100:00100000:3.0:1788448458.967271:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:0:x1875323801091200:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 13962us (14204us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788448458.967286:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:2.0:1788448458.970195:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.970546:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801091456 00000100:00100000:0.0:1788448458.970578:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801091456 00000100:00100000:0.0:1788448458.970736:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1788448458.970749:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11298:x1875323801091456:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448458.971088:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:11298:x1875323801091456:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 339us (906us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788448458.971097:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448458.977006:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448458.977105:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801091712 00000100:00100000:2.0:1788448458.977117:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801091712 00000100:00100000:2.0:1788448458.977195:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:2.0:1788448458.977219:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:11298:x1875323801091712:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788448458.977357:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:11298:x1875323801091712:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 141us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448458.977365:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:3.0:1788448458.983558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448458.983841:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801091840 00000100:00100000:1.0:1788448458.983855:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801091840 00000100:00100000:1.0:1788448458.983947:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:1.0:1788448458.983959:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:11298:x1875323801091840:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448458.983984:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448458.984011:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0694 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.984149:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803d2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.984166:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803d2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.984180:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803d2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448458.984248:0:13810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448458.984270:0:13810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803d2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.984501:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0694 expref: 25 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.984523:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803d2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0694 expref: 24 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448458.984534:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:1.0:1788448458.984538:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788448458.984542:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031e00, rc 0) 00000100:00100000:1.0:1788448458.984755:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11298:x1875323801091840:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 797us (1212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448458.984764:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:3.0:1788448458.990209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448458.990854:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801091968 00000100:00100000:0.0:1788448458.990867:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801091968 00000100:00100000:0.0:1788448458.990970:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1788448458.990982:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801091968:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448458.991005:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448458.991034:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e069b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448458.991067:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998eca, blocks: 0x0 00010000:00010000:0.0:1788448458.991092:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1788448458.991097:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448458.991109:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.991134:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448458.991152:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e200, rc 0) 00000100:00100000:0.0:1788448458.991240:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801091968:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 260us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448458.991266:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1788448459.004379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.004532:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801092224 00000100:00100000:1.0:1788448459.004545:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801092224 00000100:00100000:1.0:1788448459.004628:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:1.0:1788448459.004641:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11298:x1875323801092224:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448459.004797:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11298:x1875323801092224:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 158us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.004806:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:3.0:1788448459.019187:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.020255:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801092352 00000100:00100000:2.0:1788448459.020282:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801092352 00000100:00100000:3.0:1788448459.020432:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1788448459.020445:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:11298:x1875323801092352:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448459.020466:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448459.020494:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06a2 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.020534:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.020544:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448459.020549:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448459.020563:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.020609:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.020625:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 7 pid: 8434 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.020643:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826346496:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448459.020777:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448459.039474:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.039509:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801092480 00000100:00100000:2.0:1788448459.039520:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801092480 00010000:00010000:2.0:1788448459.039581:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 8 pid: 8434 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.039625:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1788448459.039637:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801092480:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448459.039655:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448459.039683:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 8 pid: 8434 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.039700:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 8 pid: 8434 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.039731:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448459.039736:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448459.039746:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.039758:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.039805:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.039840:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1875323826346624:192.168.206.21@tcp:105: 00000100:00100000:2.0:1788448459.039962:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb600 going to sleep for 11 seconds 00010000:00010000:3.0:1788448459.040283:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f855690/0xf45a9e4e6b803d36 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e069b expref: 8 pid: 8434 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.040300:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826346496:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448459.040332:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.040344:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ea00, rc 0) 00000100:00100000:3.0:1788448459.040386:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11298:x1875323801092352:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 19944us (21309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.040395:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:3.0:1788448459.047281:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb794e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6504:1875323826346624:192.168.206.21@tcp:105: 00010000:00010000:3.0:1788448459.047320:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448459.048367:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801092480:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 7761us (7935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.048402:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1788448459.048606:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.048663:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801092608 00000100:00100000:3.0:1788448459.048673:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801092608 00002000:00100000:3.0:1788448459.048727:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9fc186265f80 x1875323801092608/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:695/0 lens 504/0 e 0 to 0 dl 1788448470 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448459.048740:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc186265f80 with x1875323801092608 ext(0->8) 00002000:00010000:3.0:1788448459.048746:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc186265f80 00000100:00100000:3.0:1788448459.048780:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1788448459.048792:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801092608:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788448459.050531:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801092608:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 1730us (1915us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788448459.050552:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00002000:00100000:2.0:1788448459.050634:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9fc186265f80 x1875323801092608/t4294967303(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:695/0 lens 504/448 e 0 to 0 dl 1788448470 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788448459.050646:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc186265f80 with x1875323801092608 ext(0->8) 00002000:00010000:2.0:1788448459.050653:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc186265f80 00000100:00100000:2.0:1788448459.058694:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.058808:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801092736 00000100:00100000:0.0:1788448459.058821:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801092736 00000100:00100000:0.0:1788448459.059291:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:0.0:1788448459.059308:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11298:x1875323801092736:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788448459.064946:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788448459.064965:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788448459.065003:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788448459.065169:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11298:x1875323801092736:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 5862us (6482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.065180:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 90 00010000:00010000:2.0:1788448459.065504:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.065523:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.065532:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.065538:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448459.065544:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.065558:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.065579:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:2.0:1788448459.065595:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788448459.065601:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.065608:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803d13 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.065767:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448459.065787:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826346752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788448459.065857:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788448459.066916:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1788448459.066935:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788448459.067016:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826346752 00000100:00100000:0.0:1788448459.067027:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826346752 00000100:00100000:0.0:1788448459.067176:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788448459.067190:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826346752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788448459.067374:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788448459.067377:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788448458 00002000:00010000:0.0:1788448459.067380:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788448459.067382:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788448458 -> 1788448458 00002000:00010000:0.0:1788448459.067385:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788448459.067461:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826346752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 274us (1602us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788448459.067470:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:0.0:1788448459.067528:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083d51180/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788448459.067550:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826346752:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788448459.068028:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448459.076175:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.076655:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801092864 00000100:00100000:1.0:1788448459.076669:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801092864 00000100:00100000:1.0:1788448459.076745:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:1.0:1788448459.076758:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801092864:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788448459.082798:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788448459.082818:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788448459.083645:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801092864:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 6877us (7470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.083661:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1788448459.098274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.099213:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801093120 00000100:00100000:2.0:1788448459.099225:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801093120 00000100:00100000:2.0:1788448459.099294:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:2.0:1788448459.099306:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:11298:x1875323801093120:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788448459.099372:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448459.099399:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803d2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0694 expref: 14 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.099415:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:2.0:1788448459.099420:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448459.099453:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.099466:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.099476:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448459.099612:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000832ee226 reply state 0000000098dc7db5 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.099632:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.099639:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:2.0:1788448459.099642:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448459.099645:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448459.099747:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11298:x1875323801093120:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 443us (1483us total) trans 4294967357 rc 0/0 00000100:00100000:2.0:1788448459.099756:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:0.0:1788448459.109339:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.109425:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801093248 00000100:00100000:2.0:1788448459.109436:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801093248 00000100:00100000:2.0:1788448459.109495:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1788448459.109506:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801093248:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788448459.109657:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788448459.109661:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788448458 -> 1788448457 00002000:00010000:2.0:1788448459.109663:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788448456 00002000:00010000:2.0:1788448459.109666:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788448458 -> 1788448457 00002000:00010000:2.0:1788448459.109668:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788448459.109729:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5e8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801093248:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 224us (399us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788448459.109738:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1788448459.116699:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.116964:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801093504 00000100:00100000:1.0:1788448459.116974:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801093504 00000100:00100000:1.0:1788448459.117031:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:1.0:1788448459.117041:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:11298:x1875323801093504:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788448459.117104:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.117130:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 15 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.117139:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.117172:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 15 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.117185:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 15 pid: 13811 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.117211:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826346880:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448459.117307:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448459.122110:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.122161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801093632 00000100:00100000:2.0:1788448459.122169:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801093632 00010000:00010000:2.0:1788448459.122218:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 16 pid: 13811 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.122218:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826346880:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448459.122241:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.122254:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1788448459.122271:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:2398:x1875323801093632:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448459.122357:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448459.122365:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 16 pid: 13811 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.122756:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 16 pid: 13811 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.122782:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803d0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0686 expref: 16 pid: 13811 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.122799:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:2.0:1788448459.122804:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.122814:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.122821:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.122917:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448459.122966:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:2398:x1875323801093632:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 696us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.122973:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00010000:00010000:1.0:1788448459.123160:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123168:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123214:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123223:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123236:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123241:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448459.123245:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123252:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123261:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:1.0:1788448459.123264:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788448459.123268:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.123273:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d4b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.123382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:11298:x1875323801093504:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 6341us (6691us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788448459.123390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:2.0:1788448459.131834:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.131978:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801093760 00000100:00100000:1.0:1788448459.131988:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801093760 00000100:00100000:1.0:1788448459.132048:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:1.0:1788448459.132059:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801093760:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788448459.132113:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.132133:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.132152:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448459.132156:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448459.132161:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.132194:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.132219:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 7 pid: 8539 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.132234:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826347008:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448459.132305:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448459.137571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.138314:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801093888 00000100:00100000:0.0:1788448459.138334:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801093888 00010000:00010000:0.0:1788448459.138568:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448459.138908:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:0.0:1788448459.138919:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801093888:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448459.138934:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448459.138954:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.138970:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.138993:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826347008:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448459.138995:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b803d3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a2 expref: 8 pid: 8539 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.139014:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448459.139019:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448459.139024:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.139043:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139413:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.139707:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448459.139731:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139741:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139762:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448459.139768:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801093888:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 849us (2203us total) trans 0 rc 0/0 00010000:00010000:3.0:1788448459.139775:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448459.139780:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00010000:00010000:3.0:1788448459.139793:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139801:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448459.139805:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139815:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139929:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.139948:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047fa792a/0xf45a9e4e6b803d52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.140009:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801093760:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 7952us (8183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.140017:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:2.0:1788448459.142539:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.142625:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801094144 00000100:00100000:3.0:1788448459.142635:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801094144 00000100:00100000:3.0:1788448459.142730:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:3.0:1788448459.142741:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:11298:x1875323801094144:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788448459.142816:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.142839:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 14 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.142849:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.143000:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 14 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.143014:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 14 pid: 9023 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.143028:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826347136:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448459.143158:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448459.146441:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.146515:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801094272 00000100:00100000:2.0:1788448459.146536:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801094272 00010000:00010000:2.0:1788448459.146575:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 15 pid: 9023 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.146616:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:2.0:1788448459.146626:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:2398:x1875323801094272:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448459.146639:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448459.146646:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 15 pid: 9023 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.146658:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 15 pid: 9023 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.146680:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:2.0:1788448459.146685:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.146696:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.146704:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.146721:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448459.146769:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:2398:x1875323801094272:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 145us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.146777:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00010000:00010000:3.0:1788448459.147085:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803b99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e062b expref: 14 pid: 9023 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.147101:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826347136:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448459.147121:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.147129:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.147134:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.148084:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.148112:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.148120:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.148154:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.148168:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 14 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.148182:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826347264:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448459.148267:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254d480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448459.152069:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826347264:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448459.152099:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.152786:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.152982:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801094400 00000100:00100000:3.0:1788448459.152989:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801094400 00010000:00010000:3.0:1788448459.153024:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 15 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.153056:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:3.0:1788448459.153067:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:2399:x1875323801094400:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448459.153081:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448459.153098:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 15 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.153117:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 15 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.153139:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d1a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e068d expref: 15 pid: 6517 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.153151:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:3.0:1788448459.153156:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.153165:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.153172:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.153216:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448459.153269:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2399:x1875323801094400:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 203us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.153284:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00010000:00010000:1.0:1788448459.153376:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.153383:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448459.153496:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788448459.153611:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788448459.153645:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788448459.153715:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826347392:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788448459.153759:0:9023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.153815:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448459.154819:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826347392 00000100:00100000:2.0:1788448459.154839:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826347392 00000100:00100000:2.0:1788448459.155348:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788448459.155365:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9023:x1875323826347392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788448459.155527:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:9023:x1875323826347392:12345-0@lo:1000:mdt00_003.0 Request processed in 165us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.155535:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788448459.155620:0:9023:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788448459.155634:0:9023:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083d51180, transno 4294967304 00000100:00100000:1.0:1788448459.155694:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826347392:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788448459.155832:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1788448459.155995:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826347520:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788448459.156036:0:9023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.156060:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0837646c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448459.156129:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826347520 00000100:00100000:0.0:1788448459.156135:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826347520 00000100:00100000:0.0:1788448459.156163:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788448459.156171:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:9023:x1875323826347520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788448459.156354:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9023:x1875323826347520:12345-0@lo:1000:mdt00_003.0 Request processed in 182us (316us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788448459.156361:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788448459.156565:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394d500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826347520:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788448459.156601:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156610:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156617:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156624:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448459.156629:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156636:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156651:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:1.0:1788448459.156654:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448459.156658:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156664:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803d60 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156710:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156717:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156723:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156728:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448459.156731:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156737:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156745:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448459.156748:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448459.156750:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156756:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803c95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156778:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156791:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156799:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156831:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.156845:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 17 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.156857:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826347648:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448459.157056:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0837646c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448459.161045:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826347648:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448459.161055:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1788448459.161072:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.161291:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801094528 00000100:00100000:3.0:1788448459.161298:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801094528 00010000:00010000:3.0:1788448459.161331:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 18 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.161368:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:3.0:1788448459.161377:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2398:x1875323801094528:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448459.161405:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448459.161412:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 18 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.161424:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 18 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.161444:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803cb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0671 expref: 18 pid: 6518 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.161457:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:3.0:1788448459.161461:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.161471:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.161478:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.161508:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448459.161562:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:2398:x1875323801094528:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 185us (506us total) trans 0 rc 0/0 00010000:00010000:1.0:1788448459.161563:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.161570:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00010000:00010000:1.0:1788448459.161570:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161580:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161586:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161593:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161599:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448459.161603:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161617:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161626:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448459.161629:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448459.161633:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161639:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803d67 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161649:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161655:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161661:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161665:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448459.161668:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161674:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161681:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc08319cb00) 00010000:00010000:1.0:1788448459.161683:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448459.161686:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.161703:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d59 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.161980:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11298:x1875323801094144:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 19240us (19450us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788448459.161989:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 93 00000020:00080000:1.0:1788448459.161993:0:9023:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788448459.162611:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448459.162615:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448459.162626:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788448459.162630:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448459.165449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.165543:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801094784 00000100:00100000:1.0:1788448459.165552:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801094784 00000100:00100000:1.0:1788448459.165639:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448459.165650:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11298:x1875323801094784:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788448459.165873:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788448459.165973:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788448459.166004:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.166020:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.166030:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.166037:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.166043:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.166050:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.166088:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788448459.166170:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11298:x1875323801094784:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 521us (730us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788448459.166178:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000020:00080000:1.0:1788448459.166182:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788448459.166250:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448459.166257:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.166264:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448459.166274:0:9523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.166297:0:9523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.166309:0:9523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:3.0:1788448459.166313:0:9523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788448459.166317:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.166323:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803d6e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.166334:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448459.166336:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448459.166337:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448459.384646:0:14212:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448459.384656:0:14212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448459.384680:0:14212:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788448459.384685:0:14212:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448459.455676:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.455676:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826347776:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.455741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.455741:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.455801:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348160 00000100:00100000:0.0:1788448459.455808:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348160 00000100:00100000:0.0:1788448459.455853:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788448459.455863:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826348160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.455929:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826348160:12345-0@lo:400:kworker.0 Request processed in 67us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.455936:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788448459.456016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826347776 00000100:00100000:0.0:1788448459.456020:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826347776 00000100:00100000:0.0:1788448459.456045:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788448459.456051:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826347776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.456082:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b03aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826347776:12345-0@lo:400:kworker.0 Request processed in 31us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.456088:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1788448459.458512:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826347776:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.458529:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.458587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.458625:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826348800:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.458649:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.458769:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348288 00000100:00100000:0.0:1788448459.458775:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348288 00000100:00100000:0.0:1788448459.458823:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788448459.458833:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826348288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.458912:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826348288:12345-0@lo:400:kworker.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.458919:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788448459.458995:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826348288:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462595:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826348160:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462610:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826348672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462664:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.462690:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826349184:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.462755:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826347904:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462780:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.462800:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826348416:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462819:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.462836:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826348928:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.462855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.462900:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348800 00000100:00100000:1.0:1788448459.462907:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348800 00000100:00100000:1.0:1788448459.462952:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826347904 00000100:00100000:1.0:1788448459.462955:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826347904 00000100:00100000:1.0:1788448459.462968:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348416 00000100:00100000:1.0:1788448459.462970:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348416 00000100:00100000:1.0:1788448459.462981:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348928 00000100:00100000:1.0:1788448459.462983:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348928 00000100:00100000:1.0:1788448459.462998:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788448459.463007:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826348800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463034:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788448459.463042:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826348032:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.463058:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826348800:12345-0@lo:400:kworker.0 Request processed in 52us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.463066:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.463073:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788448459.463089:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788448459.463095:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826347904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.463124:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826347904:12345-0@lo:400:kworker.0 Request processed in 29us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.463130:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788448459.463141:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788448459.463147:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826348416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463152:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826348544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463173:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.463173:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826348416:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.463178:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788448459.463183:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826349056:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.463187:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348544 00000100:00100000:1.0:1788448459.463190:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348544 00000100:00100000:2.0:1788448459.463214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448459.463217:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788448459.463222:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826348928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463239:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826347904:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463249:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826348416:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.463262:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826348928:12345-0@lo:400:kworker.0 Request processed in 40us (406us total) trans 0 rc 0/0 00010000:00080000:2.0:1788448459.463267:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083d52300 x1875323826348928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448459.463268:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788448459.463276:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826348928:0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.463279:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788448459.463284:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826348544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463301:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348672 00000100:00100000:2.0:1788448459.463304:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348672 00000100:00100000:1.0:1788448459.463315:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826348544:12345-0@lo:400:kworker.0 Request processed in 31us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.463321:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788448459.463329:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826349184 00000100:00100000:2.0:1788448459.463331:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826349184 00000100:00080000:1.0:1788448459.463336:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448459.463340:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448459.463342:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826349056 00000100:00100000:2.0:1788448459.463344:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826349056 00000100:00080000:1.0:1788448459.463347:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448459.463350:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448459.463358:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448459.463363:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826348672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448459.463369:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826348800:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463396:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826348672:12345-0@lo:400:kworker.0 Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.463402:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448459.463414:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788448459.463420:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826349184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463446:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826349184:12345-0@lo:400:kworker.0 Request processed in 26us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.463451:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788448459.463469:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788448459.463475:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826349056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463501:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826349056:12345-0@lo:400:kworker.0 Request processed in 26us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.463506:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00080000:2.0:1788448459.463534:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083d53100 x1875323826348544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448459.463543:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826348544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463554:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826349056:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463576:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826348672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.463586:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826349184:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.465709:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826348032 00000100:00100000:0.0:1788448459.465721:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826348032 00000100:00100000:0.0:1788448459.465778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788448459.465789:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826348032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.465867:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826348032:12345-0@lo:400:kworker.0 Request processed in 80us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.465875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788448459.467049:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826348032:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.508219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.508463:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801095040 00000100:00100000:3.0:1788448459.508472:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801095040 00000100:00100000:3.0:1788448459.508535:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:3.0:1788448459.508546:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:11308:x1875323801095040:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448459.508567:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448459.508586:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.508686:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803d7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.508713:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803d7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.508724:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803d7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448459.508737:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788448459.508826:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803d75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a9 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.508845:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803d7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a9 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.508853:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448459.508856:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448459.508859:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e000, rc 0) 00000100:00100000:3.0:1788448459.508942:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11308:x1875323801095040:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 397us (731us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788448459.508950:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:1.0:1788448459.514511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.514591:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801095168 00000100:00100000:3.0:1788448459.514601:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801095168 00000100:00100000:3.0:1788448459.514653:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:3.0:1788448459.514663:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11308:x1875323801095168:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:3.0:1788448459.514727:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514742:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514766:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514779:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514786:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514792:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514861:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514869:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514876:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448459.514950:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514962:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514967:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514974:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.514989:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448459.514993:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515000:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515012:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448459.515016:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448459.515020:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515026:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803d8a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515036:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515041:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515046:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515051:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448459.515053:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515059:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515627:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb42bf00) 00010000:00010000:3.0:1788448459.515630:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448459.515634:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515641:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803d91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515658:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515665:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515672:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515678:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448459.515681:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515688:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515696:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42b100) 00010000:00010000:3.0:1788448459.515698:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448459.515701:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.515707:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.515799:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11308:x1875323801095168:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 1135us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.515808:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:0.0:1788448459.570269:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.570339:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801095424 00000100:00100000:3.0:1788448459.570348:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801095424 00000100:00100000:3.0:1788448459.570409:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:3.0:1788448459.570421:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11311:x1875323801095424:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448459.570439:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448459.570458:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d9f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06b0 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570522:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570536:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570546:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570561:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570569:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570575:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570683:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570692:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570699:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448459.570709:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788448459.570778:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570786:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570792:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570797:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448459.570802:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570809:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570821:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448459.570824:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448459.570828:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570846:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803da6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570860:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570867:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.570873:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572365:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448459.572377:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572388:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572401:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb42b100) 00010000:00010000:3.0:1788448459.572405:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448459.572408:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572415:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803dad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572467:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803d9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 23 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572496:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 22 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.572503:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:3.0:1788448459.572506:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448459.572508:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448459.572581:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11311:x1875323801095424:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 2162us (2320us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788448459.572590:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:0.0:1788448459.578238:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.578378:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801095552 00000100:00100000:3.0:1788448459.578388:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801095552 00000100:00100000:3.0:1788448459.578442:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:3.0:1788448459.578453:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11311:x1875323801095552:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:3.0:1788448459.578514:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578529:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578540:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578572:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578580:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578598:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578604:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448459.578609:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578616:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578629:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:3.0:1788448459.578632:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448459.578636:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.578642:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dc2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.578703:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11311:x1875323801095552:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 252us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.578711:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:0.0:1788448459.583252:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.583290:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801095808 00000100:00100000:0.0:1788448459.583299:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801095808 00000100:00100000:0.0:1788448459.583349:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1788448459.583359:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11311:x1875323801095808:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448459.583563:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:11311:x1875323801095808:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 205us (319us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788448459.583571:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1788448459.619682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.619831:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096064 00000100:00100000:2.0:1788448459.619840:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096064 00000100:00100000:2.0:1788448459.619940:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:2.0:1788448459.619951:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:10838:x1875323801096064:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1788448459.619973:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448459.619993:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803dc9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06b7 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.620104:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.620117:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 24 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.620140:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.620173:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 24 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.620187:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 24 pid: 13810 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.620211:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d51500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826349312:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448459.620302:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448459.622968:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.623010:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.623048:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.623087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.623090:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096448 00000100:00100000:1.0:1788448459.623098:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096448 00000100:00100000:0.0:1788448459.623109:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.623133:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.623139:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096576 00000100:00100000:1.0:1788448459.623142:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096576 00000100:00100000:0.0:1788448459.623155:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:0.0:1788448459.623165:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801096448:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448459.623168:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:1.0:1788448459.623173:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801096576:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448459.623236:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801096576:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.623243:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:2.0:1788448459.623249:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096192 00000100:00100000:2.0:1788448459.623253:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096192 00000100:00080000:1.0:1788448459.623265:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448459.623293:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 384 00000100:00100000:2.0:1788448459.623300:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801096192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448459.623360:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096704 00000100:00100000:3.0:1788448459.623365:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096704 00000100:00100000:3.0:1788448459.623399:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096320 00000100:00100000:3.0:1788448459.623403:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096320 00000100:00100000:3.0:1788448459.623421:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096832 00000100:00100000:3.0:1788448459.623424:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096832 00000100:00100000:3.0:1788448459.623438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 304 00000100:00100000:3.0:1788448459.623444:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801096704:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448459.624237:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801096448:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1069us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.624245:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:0.0:1788448459.625748:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:0.0:1788448459.625769:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801096320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448459.625822:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801096320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.625829:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:0.0:1788448459.625857:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 306 00000100:00100000:0.0:1788448459.625865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801096832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448459.626206:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801096832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 330us (3060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.626230:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 306 00000100:00100000:2.0:1788448459.626751:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801096192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3448us (3788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.626761:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 384 00000100:00080000:0.0:1788448459.627000:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448459.627006:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448459.627222:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.627750:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d51500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826349312:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448459.627774:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448459.628878:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801096704:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5428us (5824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.628921:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 304 00000100:00100000:2.0:1788448459.629002:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801096960 00000100:00100000:2.0:1788448459.629009:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801096960 00010000:00010000:2.0:1788448459.629039:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 25 pid: 13810 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.629076:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:2.0:1788448459.629086:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:2398:x1875323801096960:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448459.629109:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448459.629116:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 25 pid: 13810 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.629129:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 25 pid: 13810 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.629148:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b803db4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b0 expref: 25 pid: 13810 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.629163:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:2.0:1788448459.629168:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.629176:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.629184:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.629225:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448459.629251:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.629254:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:2398:x1875323801096960:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 171us (2035us total) trans 0 rc 0/0 00010000:00010000:1.0:1788448459.629259:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.629261:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000004:00200000:1.0:1788448459.629277:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788448459.629390:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b803dc9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 25 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.629406:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 24 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.629413:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:1.0:1788448459.629415:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448459.629424:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331c00, rc 0) 00000100:00100000:1.0:1788448459.629448:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:10838:x1875323801096064:12345-192.168.206.21@tcp:101:bash.0 Request processed in 9499us (9775us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788448459.629456:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:2.0:1788448459.633004:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.633163:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801097088 00000100:00100000:0.0:1788448459.633172:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801097088 00000100:00100000:0.0:1788448459.633238:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:0.0:1788448459.633249:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:10838:x1875323801097088:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1788448459.633270:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448459.633394:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803dde lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06be expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.633430:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803de5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.633443:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.633454:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803de5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.633567:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803dde lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06be expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.633584:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803de5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06be expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.633600:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:0.0:1788448459.633603:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448459.633606:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e200, rc 0) 00000100:00100000:0.0:1788448459.633705:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:10838:x1875323801097088:12345-192.168.206.21@tcp:101:bash.0 Request processed in 457us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.633713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:0.0:1788448459.636933:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.637456:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801097344 00000100:00100000:3.0:1788448459.637466:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801097344 00000100:00100000:3.0:1788448459.637556:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:3.0:1788448459.637567:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:10838:x1875323801097344:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:3.0:1788448459.637767:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.637783:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.637795:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448459.637835:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788448459.637857:0:13810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad3a34e7 reply state 0000000041bf897d transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.637869:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.637876:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:3.0:1788448459.637912:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448459.637917:0:13810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788448459.637993:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788448459.638094:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:10838:x1875323801097344:12345-192.168.206.21@tcp:36:bash.0 Request processed in 528us (1167us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788448459.638100:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 100 00000020:00080000:3.0:1788448459.638112:0:13810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788448459.640531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.640609:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801097472 00000100:00100000:3.0:1788448459.640617:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801097472 00000100:00100000:3.0:1788448459.640668:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:3.0:1788448459.640677:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:10838:x1875323801097472:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448459.640697:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448459.640713:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803df3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06c5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.640760:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803df3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06c5 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.640774:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803df3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06c5 expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448459.640791:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:3.0:1788448459.640795:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448459.640798:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:3.0:1788448459.640853:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:10838:x1875323801097472:12345-192.168.206.21@tcp:101:bash.0 Request processed in 177us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.640861:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:0.0:1788448459.652815:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.653360:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801097600 00000100:00100000:1.0:1788448459.653369:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801097600 00000100:00100000:1.0:1788448459.653431:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:1.0:1788448459.653442:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:10838:x1875323801097600:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448459.653462:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448459.653482:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06cc expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448459.653521:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a998ec9, atime: 0x6a998ec8, ctime: 0x6a998ec9, blocks: 0x8 00010000:00010000:1.0:1788448459.653544:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1788448459.653550:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448459.653558:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.653576:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.653589:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030a00, rc 0) 00000100:00100000:1.0:1788448459.653638:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:10838:x1875323801097600:12345-192.168.206.21@tcp:101:bash.0 Request processed in 198us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.653645:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:0.0:1788448459.656432:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448459.656616:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801097728 00000100:00100000:1.0:1788448459.656626:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801097728 00002000:00010000:1.0:1788448459.656663:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788448459.656668:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc0835d0700 with x1875323801097728 ext(0->18446744073709551615) 00002000:00010000:1.0:1788448459.656680:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc0835d0700. 00000100:00100000:1.0:1788448459.656751:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:1.0:1788448459.656761:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801097728:12345-192.168.206.21@tcp:10:bash.0 00002000:00010000:1.0:1788448459.657054:0:8437:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788448459.657058:0:8437:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788448457 -> 1788448459 00002000:00010000:1.0:1788448459.657061:0:8437:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788448456 -> 1788448456 00002000:00010000:1.0:1788448459.657255:0:8437:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788448457 -> 1788448459 00002000:00010000:1.0:1788448459.657258:0:8437:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788448459.657314:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801097728:12345-192.168.206.21@tcp:10:bash.0 Request processed in 553us (891us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788448459.657323:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00002000:00010000:1.0:1788448459.657327:0:8437:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:1.0:1788448459.657330:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc0835d0700 with x1875323801097728 ext(0->18446744073709551615) 00002000:00010000:1.0:1788448459.657335:0:8437:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc0835d0700. 00000100:00100000:0.0:1788448459.762255:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.762394:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801097856 00000100:00100000:2.0:1788448459.762404:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801097856 00000100:00100000:2.0:1788448459.762467:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:2.0:1788448459.762478:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11325:x1875323801097856:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1788448459.762558:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762574:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762587:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762602:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762610:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762616:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762687:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762695:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762702:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448459.762758:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762768:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762785:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762791:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762797:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448459.762801:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762808:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762820:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448459.762823:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448459.762828:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762833:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762845:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762851:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762856:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762861:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448459.762870:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762877:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762939:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:2.0:1788448459.762942:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448459.762945:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762951:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e08 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762967:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762973:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762978:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762983:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448459.762986:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762991:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.762998:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:2.0:1788448459.763000:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448459.763009:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.763015:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448459.763093:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11325:x1875323801097856:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 615us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.763100:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 102 00010000:00010000:2.0:1788448459.776142:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448459.827130:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448459.827775:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801098112 00000100:00100000:2.0:1788448459.827787:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801098112 00000100:00100000:2.0:1788448459.827846:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:2.0:1788448459.827857:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11328:x1875323801098112:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448459.827876:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448459.827912:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e16 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06d3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.827985:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.827999:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828009:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828022:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828029:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828047:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828158:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803e2b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828167:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803e2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828174:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803e2b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448459.828183:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788448459.828273:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828281:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828287:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828293:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448459.828298:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828306:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828318:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448459.828321:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448459.828332:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828338:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e1d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828350:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828356:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828361:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828366:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448459.828369:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828375:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828383:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:2.0:1788448459.828385:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448459.828388:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828393:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803e24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828431:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803e16 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06d3 expref: 33 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828459:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803e2b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06d3 expref: 32 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448459.828466:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:2.0:1788448459.828468:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788448459.828470:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331400, rc 0) 00000100:00100000:2.0:1788448459.828524:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11328:x1875323801098112:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 668us (1402us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788448459.828531:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:3.0:1788448459.832159:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.832260:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801098240 00000100:00100000:0.0:1788448459.832269:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801098240 00000100:00100000:0.0:1788448459.832327:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:0.0:1788448459.832339:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11328:x1875323801098240:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1788448459.832405:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.832421:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 32 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.832431:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.832465:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 32 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.832500:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 32 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448459.832521:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826349440:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448459.832611:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448459.836740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448459.836850:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826349440:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448459.836877:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.837998:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801098496 00000100:00100000:1.0:1788448459.838009:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801098496 00000100:00100000:1.0:1788448459.838067:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1788448459.838078:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+33:6169:x1875323801098496:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788448459.838482:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:6169:x1875323801098496:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 402us (1759us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788448459.838490:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788448459.840939:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.841009:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801098624 00000100:00100000:0.0:1788448459.841016:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801098624 00010000:00010000:0.0:1788448459.841052:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 34 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448459.841099:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1788448459.841108:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:2399:x1875323801098624:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448459.841120:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448459.841126:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 34 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.841140:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 34 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.841161:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803dd0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06b7 expref: 34 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.841176:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:0.0:1788448459.841181:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.841214:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.841222:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.841260:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448459.841772:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+33:2399:x1875323801098624:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 661us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.841781:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00010000:00010000:1.0:1788448459.843831:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843862:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843937:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843945:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843952:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843957:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448459.843961:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843968:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843984:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:1.0:1788448459.843987:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448459.843992:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448459.843999:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448459.844078:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11328:x1875323801098240:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 11737us (11924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448459.844087:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:3.0:1788448459.852988:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.853094:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801098880 00000100:00100000:0.0:1788448459.853103:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801098880 00000100:00100000:0.0:1788448459.853157:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1788448459.853167:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:11328:x1875323801098880:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448459.853385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+33:11328:x1875323801098880:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 219us (405us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788448459.853393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:1.0:1788448459.966443:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826349568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448459.966513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448459.966659:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826349568 00000100:00100000:3.0:1788448459.966677:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826349568 00000100:00100000:3.0:1788448459.966724:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788448459.966733:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826349568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448459.966759:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448459.966806:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826349568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.966814:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788448459.966860:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826349568:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448459.967552:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448459.967590:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.967698:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826349696 00000100:00100000:2.0:1788448459.967703:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826349696 00000100:00100000:2.0:1788448459.967736:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788448459.967743:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826349696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448459.967755:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448459.967793:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826349696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.967799:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788448459.967904:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826349696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448459.996358:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448459.996503:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801099136 00000100:00100000:0.0:1788448459.996513:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801099136 00000100:00100000:0.0:1788448459.996573:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:0.0:1788448459.996584:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+33:11339:x1875323801099136:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:0.0:1788448459.996608:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448459.996643:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803e40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06da expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996713:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996727:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996738:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996753:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996759:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996765:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996870:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803e55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996906:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.996915:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803e55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448459.996925:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788448459.996997:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997014:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997021:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997027:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448459.997031:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997038:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997050:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448459.997052:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448459.997056:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997062:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803e47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997073:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997080:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997086:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997091:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448459.997098:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997104:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997111:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc08336af00) 00010000:00010000:0.0:1788448459.997114:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448459.997116:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997122:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b803e4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997156:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b803e40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06da expref: 36 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997168:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803e55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06da expref: 35 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448459.997175:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:0.0:1788448459.997178:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448459.997180:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f800, rc 0) 00000100:00100000:0.0:1788448459.997251:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11339:x1875323801099136:12345-192.168.206.21@tcp:101:cat.0 Request processed in 669us (902us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788448459.997258:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:2.0:1788448460.004098:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.004182:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801099392 00000100:00100000:1.0:1788448460.004192:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801099392 00000100:00100000:1.0:1788448460.004274:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1788448460.004290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11339:x1875323801099392:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:1.0:1788448460.004568:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+36:11339:x1875323801099392:12345-192.168.206.21@tcp:35:cat.0 Request processed in 277us (478us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788448460.004576:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00080000:0.0:1788448460.004632:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448460.031128:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.031247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801099648 00000100:00100000:2.0:1788448460.031257:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801099648 00000100:00100000:2.0:1788448460.031466:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:2.0:1788448460.031477:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+36:11340:x1875323801099648:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788448460.031852:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788448460.032004:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803df3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06c5 expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032027:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803e55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06da expref: 35 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032042:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803e2b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06d3 expref: 34 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032054:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803de5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06be expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032063:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:2.0:1788448460.032068:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448460.032090:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032102:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032112:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032126:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032133:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032140:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032255:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032264:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032271:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448460.032705:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1788448460.032715:0:6517:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 377377833294ns, next at 378377830460ns, rc = 0 00010000:00010000:2.0:1788448460.032774:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032783:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032792:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032799:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032805:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032812:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032902:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448460.032923:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032935:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032941:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032946:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.032951:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032958:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032968:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:2.0:1788448460.032971:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788448460.032974:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032980:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803e71 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.032995:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033000:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033005:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033010:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.033019:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033025:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033033:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448460.033035:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448460.033038:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033044:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803e63 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448460.033054:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001435fbda reply state 000000001de54f76 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033065:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.033071:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:2.0:1788448460.033073:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448460.033076:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448460.033160:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:11340:x1875323801099648:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1683us (2039us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788448460.033169:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 106 00010000:00010000:1.0:1788448460.035021:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448460.035034:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.035045:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448460.035050:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.035058:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.035074:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:1.0:1788448460.035077:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788448460.035081:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.035098:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803e78 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.035117:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448460.035133:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448460.035135:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448460.087430:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.088639:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801099904 00000100:00100000:1.0:1788448460.088651:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801099904 00000100:00100000:1.0:1788448460.088731:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:1.0:1788448460.088742:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:11346:x1875323801099904:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448460.088766:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448460.088784:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803e7f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06e1 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.088922:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.088936:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.088947:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.088959:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.088967:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.088973:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448460.089285:0:13811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788448460.092442:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092485:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092497:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092607:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092630:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092637:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092656:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448460.092661:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092681:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092705:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448460.092709:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448460.092713:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092719:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803e86 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448460.092736:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6bf5014 reply state 00000000724cdf04 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092754:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092761:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:1.0:1788448460.092764:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448460.092767:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788448460.092807:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b803e7f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 37 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.092824:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 36 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.093160:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:1.0:1788448460.093229:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448460.093232:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031e00, rc 0) 00000100:00100000:1.0:1788448460.093389:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:11346:x1875323801099904:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4647us (5966us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788448460.093399:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:0.0:1788448460.098551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.098721:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801100032 00000100:00100000:1.0:1788448460.098730:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801100032 00000100:00100000:1.0:1788448460.098784:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:1.0:1788448460.098794:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801100032:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448460.098809:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448460.098827:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06e8 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448460.098852:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448460.099055:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=377s v=(0 0) 00010000:00010000:1.0:1788448460.099061:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448460.099080:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.099100:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.099117:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030e00, rc 0) 00000100:00100000:1.0:1788448460.099297:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801100032:12345-192.168.206.21@tcp:101:bash.0 Request processed in 503us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448460.099305:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:3.0:1788448460.102467:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.106547:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801100160 00000100:00100000:1.0:1788448460.106562:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801100160 00000100:00100000:1.0:1788448460.106640:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:1.0:1788448460.106650:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:11346:x1875323801100160:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448460.106666:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448460.106683:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06ef expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.106714:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.106724:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448460.106729:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448460.106734:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.106811:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.107316:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 9 pid: 8433 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448460.107408:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875323826349824:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448460.107586:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448460.111414:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.111710:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801100288 00000100:00100000:2.0:1788448460.111719:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801100288 00010000:00010000:2.0:1788448460.111758:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 10 pid: 8433 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.111829:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:2.0:1788448460.111839:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2399:x1875323801100288:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448460.111864:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448460.111914:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 10 pid: 8433 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.111928:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 10 pid: 8433 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.111952:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448460.111956:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448460.111963:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.111972:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.112007:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 10 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.112021:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875323826349952:192.168.206.21@tcp:105: 00000100:00100000:2.0:1788448460.112115:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb300 going to sleep for 11 seconds 00010000:00010000:1.0:1788448460.112370:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006fa27297/0xf45a9e4e6b803ea2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e8 expref: 10 pid: 8433 timeout: 477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448460.112386:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8434:1875323826349824:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448460.112407:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 9 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.112417:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:1.0:1788448460.112444:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:11346:x1875323801100160:12345-192.168.206.21@tcp:101:bash.0 Request processed in 5795us (9985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448460.112452:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1788448460.116587:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.116723:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801100544 00000100:00100000:1.0:1788448460.116739:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801100544 00000100:00100000:1.0:1788448460.116809:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1788448460.116820:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:11346:x1875323801100544:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:1.0:1788448460.117410:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11346:x1875323801100544:12345-192.168.206.21@tcp:35:bash.0 Request processed in 590us (829us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788448460.117418:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:2.0:1788448460.119959:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875323826349952:192.168.206.21@tcp:105: 00010000:00010000:2.0:1788448460.119998:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448460.120091:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801100288:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 8252us (8685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448460.120101:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:2.0:1788448460.339060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.339496:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801100672 00000100:00100000:0.0:1788448460.339520:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801100672 00000100:00100000:0.0:1788448460.339580:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:0.0:1788448460.339588:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:11363:x1875323801100672:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448460.339610:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448460.339627:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803eb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06f6 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.339687:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803eb7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.339701:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.339716:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448460.339755:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788448460.339759:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448460.339774:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803eb7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.339794:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b803eb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06f6 expref: 40 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.339814:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803eb7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06f6 expref: 39 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.339822:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448460.339825:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448460.339828:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f600, rc 0) 00000100:00100000:0.0:1788448460.339930:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:11363:x1875323801100672:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 342us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.339937:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:0.0:1788448460.348595:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.348673:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801100928 00000100:00100000:3.0:1788448460.348681:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801100928 00000100:00100000:3.0:1788448460.348779:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:3.0:1788448460.348790:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:11363:x1875323801100928:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448460.348808:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448460.348839:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803ebe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e06fd expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.348973:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803ec5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.348985:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.348996:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448460.349006:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788448460.349124:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803ebe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06fd expref: 42 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.349143:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06fd expref: 41 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.349151:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:3.0:1788448460.349154:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448460.349158:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e800, rc 0) 00000100:00100000:3.0:1788448460.349227:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+41:11363:x1875323801100928:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 439us (639us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788448460.349233:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:1.0:1788448460.358635:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.358683:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.358763:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801101312 00000100:00100000:0.0:1788448460.358772:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801101312 00000100:00100000:0.0:1788448460.359259:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448460.359270:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+41:2399:x1875323801101312:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448460.359284:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448460.359306:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803ec5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06fd expref: 41 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.359325:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:0.0:1788448460.359329:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448460.359540:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:2399:x1875323801101312:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 271us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.359547:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:2.0:1788448460.361805:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801101184 00000100:00100000:2.0:1788448460.361819:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801101184 00000100:00100000:2.0:1788448460.361918:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:2.0:1788448460.361928:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:11363:x1875323801101184:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448460.361950:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448460.361968:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803ed3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0704 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.362060:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803eda lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.362074:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.362084:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803eda lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448460.362095:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788448460.362187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803ed3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0704 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.362319:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803eda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0704 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.362345:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:2.0:1788448460.362348:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788448460.362352:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331400, rc 0) 00000100:00100000:2.0:1788448460.362539:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+42:11363:x1875323801101184:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 611us (3912us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788448460.362547:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:1.0:1788448460.383381:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.383533:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801101440 00000100:00100000:0.0:1788448460.383543:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801101440 00000100:00100000:0.0:1788448460.383596:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1788448460.383606:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801101440:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:0.0:1788448460.383645:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.383664:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.383701:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448460.383705:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448460.383710:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.383743:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.383756:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 8 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448460.383771:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875323826350080:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448460.383920:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448460.390161:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.390222:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801101568 00000100:00100000:3.0:1788448460.390231:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801101568 00002000:00100000:3.0:1788448460.390279:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9fc1ba1f0700 x1875323801101568/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:696/0 lens 504/0 e 0 to 0 dl 1788448471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448460.390295:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc1ba1f0700 with x1875323801101568 ext(0->8) 00010000:00010000:3.0:1788448460.390304:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 9 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.390318:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 9 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.390318:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875323826350080:192.168.206.21@tcp:104: 00002000:00010000:3.0:1788448460.390325:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc1ba1f0700 00010000:00010000:2.0:1788448460.390342:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.390402:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1788448460.390413:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801101568:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:3.0:1788448460.391507:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2398:x1875323801101568:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 1091us (1351us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788448460.391524:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00002000:00100000:3.0:1788448460.391534:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9fc1ba1f0700 x1875323801101568/t4294967303(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:696/0 lens 504/448 e 0 to 0 dl 1788448471 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448460.391543:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc1ba1f0700 with x1875323801101568 ext(0->8) 00010000:00010000:3.0:1788448460.391551:0:8439:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 11 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.391565:0:8439:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 11 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448460.391572:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc1ba1f0700 00000100:00100000:2.0:1788448460.395516:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.395617:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801101696 00000100:00100000:3.0:1788448460.395627:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801101696 00010000:00010000:3.0:1788448460.395732:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 11 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.395814:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:3.0:1788448460.395833:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2400:x1875323801101696:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448460.395849:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788448460.395867:0:13187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788448460.395869:0:13187:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788448459 00002000:00010000:3.0:1788448460.395872:0:13187:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788448460 00002000:00010000:3.0:1788448460.395874:0:13187:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788448459 00002000:00010000:3.0:1788448460.395876:0:13187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788448460.395921:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 11 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.395949:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 11 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.395973:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a158c3f/0xf45a9e4e6b803ea9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06ef expref: 11 pid: 8434 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.395990:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448460.395995:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448460.396000:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.396009:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.396046:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448460.396119:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2400:x1875323801101696:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 295us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.396127:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00010000:00010000:0.0:1788448460.396228:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396236:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396265:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396272:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396292:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396298:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ec00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448460.396303:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396311:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396322:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.396330:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4ca1346/0xf45a9e4e6b803ee8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448460.396372:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801101440:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 12768us (13000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.396381:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:1.0:1788448460.400270:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.400432:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801101952 00000100:00100000:2.0:1788448460.400442:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801101952 00000100:00100000:2.0:1788448460.400501:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1788448460.400512:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+42:11363:x1875323801101952:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:2.0:1788448460.400581:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803eda lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0704 expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448460.401525:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788448460.401564:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788448460.402175:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788448460.402229:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.402422:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 46 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.402445:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.402481:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 46 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.402495:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 46 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.402510:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875323826350208:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448460.402811:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788448460.405616:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.405717:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801102080 00000100:00100000:3.0:1788448460.405726:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801102080 00010000:00010000:3.0:1788448460.405760:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 47 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.405795:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:3.0:1788448460.405805:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:2399:x1875323801102080:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448460.405840:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448460.405846:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 47 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.405855:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875323826350208:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448460.405857:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 47 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.405876:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b803e94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06e1 expref: 47 pid: 13811 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.406021:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.406127:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:3.0:1788448460.406133:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.406142:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.406149:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.406179:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448460.406306:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.406313:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448460.406408:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788448460.406524:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788448460.406620:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826350336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788448460.406660:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+48:2399:x1875323801102080:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 855us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448460.406668:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448460.406693:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448460.406735:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:0.0:1788448460.406983:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826350336 00000100:00100000:0.0:1788448460.406988:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826350336 00000100:00100000:0.0:1788448460.407036:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00080000:2.0:1788448460.407042:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448460.407046:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1875323826350336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788448460.407137:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6520:x1875323826350336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 92us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.407154:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788448460.407545:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826350336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788448460.407653:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788448460.407716:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826350464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788448460.407749:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448460.407775:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448460.408005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826350464 00000100:00100000:3.0:1788448460.408012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826350464 00000100:00100000:3.0:1788448460.408054:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788448460.408063:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6520:x1875323826350464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788448460.408165:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6520:x1875323826350464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (414us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788448460.408211:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826350464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788448460.408247:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00000100:00100000:3.0:1788448460.408249:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00010000:2.0:1788448460.408353:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.408365:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.408372:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.408377:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.408381:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.408388:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.408402:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:2.0:1788448460.408405:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788448460.408410:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.408416:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803eef lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448460.408510:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788448460.408561:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788448460.408571:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377753688981ns, next at 378753687191ns, rc = 0 00000001:00080000:2.0:1788448460.408577:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788448460.408598:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08319c700) 00010000:00010000:2.0:1788448460.408601:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788448460.408607:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803eda lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0704 expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.408693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+49:11363:x1875323801101952:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 8183us (8431us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788448460.408700:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000020:00080000:2.0:1788448460.408704:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788448460.411594:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.411660:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801102208 00000100:00100000:0.0:1788448460.411669:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801102208 00000100:00100000:0.0:1788448460.411727:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:0.0:1788448460.411738:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+49:11363:x1875323801102208:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448460.411758:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448460.411778:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803ef6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e070b expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.411832:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e070b expref: 50 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.411846:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e070b expref: 50 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.411863:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448460.411866:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448460.411870:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ec00, rc 0) 00000100:00100000:0.0:1788448460.411949:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:11363:x1875323801102208:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 213us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.411957:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:1.0:1788448460.423262:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.423758:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801102464 00000100:00100000:0.0:1788448460.423768:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801102464 00000100:00100000:0.0:1788448460.423827:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:0.0:1788448460.423837:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:11363:x1875323801102464:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448460.424102:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:11363:x1875323801102464:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 265us (848us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788448460.424122:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:2.0:1788448460.478186:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826350592:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448460.478268:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448460.478415:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826350592 00000100:00100000:3.0:1788448460.478424:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826350592 00000100:00100000:3.0:1788448460.478472:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788448460.478482:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826350592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448460.478512:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788448460.478569:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826350592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.478578:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788448460.478698:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826350592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448460.500996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.501091:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801102592 00000100:00100000:2.0:1788448460.501101:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801102592 00000100:00100000:2.0:1788448460.501169:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:2.0:1788448460.501180:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:11373:x1875323801102592:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1788448460.501257:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501274:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501285:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501311:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501319:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501325:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501414:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501423:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501430:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448460.501473:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501485:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501492:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501499:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501504:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.501509:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501522:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501534:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448460.501537:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448460.501541:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501547:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803efd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501560:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501566:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501572:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501576:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.501578:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501584:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501591:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:2.0:1788448460.501594:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448460.501596:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501613:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501622:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501628:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501634:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501639:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.501641:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501647:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501654:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448460.501656:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448460.501659:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.501665:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.501731:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:11373:x1875323801102592:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 552us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448460.501739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:1.0:1788448460.560449:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.562106:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801102848 00000100:00100000:2.0:1788448460.562120:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801102848 00000100:00100000:2.0:1788448460.562310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:2.0:1788448460.562321:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:11376:x1875323801102848:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448460.562340:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448460.562370:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0712 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562436:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562450:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562461:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562472:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562479:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562486:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562584:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562593:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562630:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448460.562640:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788448460.562715:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562723:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562729:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562735:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.562739:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562747:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562758:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448460.562760:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448460.562765:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562770:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562793:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562799:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562811:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562816:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448460.562819:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562825:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562834:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:2.0:1788448460.562836:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448460.562839:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562845:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562877:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562929:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.562937:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448460.562939:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448460.562941:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331a00, rc 0) 00000100:00100000:2.0:1788448460.563020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:11376:x1875323801102848:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 702us (2590us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788448460.563037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:1.0:1788448460.568990:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.569087:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801102976 00000100:00100000:0.0:1788448460.569097:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801102976 00000100:00100000:0.0:1788448460.569159:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:0.0:1788448460.569169:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:11376:x1875323801102976:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1788448460.569245:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569267:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569280:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569326:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569334:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569341:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569347:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448460.569352:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569359:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569370:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448460.569386:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448460.569391:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.569397:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b803f35 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448460.569514:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:11376:x1875323801102976:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 346us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.569526:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:0.0:1788448460.571992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.572033:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801103232 00000100:00100000:2.0:1788448460.572041:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801103232 00000100:00100000:2.0:1788448460.572088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:2.0:1788448460.572095:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:11376:x1875323801103232:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448460.572291:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11376:x1875323801103232:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 194us (305us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788448460.572300:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:1.0:1788448460.671305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.671432:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801103488 00000100:00100000:2.0:1788448460.671452:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801103488 00000100:00100000:2.0:1788448460.671511:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:2.0:1788448460.671521:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11386:x1875323801103488:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1788448460.671541:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448460.671544:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788448460.671569:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b803eb7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06f6 expref: 54 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.671587:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448460.671591:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448460.671603:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f3c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0719 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.671693:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.671706:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.671725:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.671755:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.671768:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 54 pid: 6519 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.671780:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d53100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826350720:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448460.672043:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1922ab3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448460.678127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.678237:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d53100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826350720:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448460.678273:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.678381:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801103616 00000100:00100000:3.0:1788448460.678390:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801103616 00010000:00010000:3.0:1788448460.678426:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 55 pid: 6519 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.678477:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:3.0:1788448460.678488:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+55:2399:x1875323801103616:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448460.678502:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448460.678510:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 55 pid: 6519 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.678523:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 55 pid: 6519 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.678544:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b803f27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0712 expref: 55 pid: 6519 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.678559:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.678575:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.678585:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.678592:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.678620:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448460.678675:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:2399:x1875323801103616:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 189us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.678682:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00010000:00010000:2.0:1788448460.678745:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.678752:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448460.678770:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788448460.678946:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b803f3c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.678962:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 54 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.678980:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448460.678983:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788448460.678986:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331400, rc 0) 00000100:00100000:2.0:1788448460.679013:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11386:x1875323801103488:12345-192.168.206.21@tcp:101:bash.0 Request processed in 7494us (7717us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788448460.679020:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1788448460.687689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448460.687783:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801103744 00000100:00100000:1.0:1788448460.687794:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801103744 00000100:00100000:1.0:1788448460.687859:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:1.0:1788448460.687868:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:11386:x1875323801103744:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448460.687928:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448460.687946:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803f51 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0720 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.687980:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.687995:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.688020:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.688290:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b803f51 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 56 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.688308:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 55 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448460.688317:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:1.0:1788448460.688321:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448460.688324:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031600, rc 0) 00000100:00100000:1.0:1788448460.688387:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+55:11386:x1875323801103744:12345-192.168.206.21@tcp:101:bash.0 Request processed in 520us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448460.688395:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:1.0:1788448460.698838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.698958:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801104000 00000100:00100000:3.0:1788448460.698968:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801104000 00000100:00100000:3.0:1788448460.699024:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:3.0:1788448460.699034:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+55:11386:x1875323801104000:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:3.0:1788448460.699251:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.699270:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.699281:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448460.699325:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1788448460.699348:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001882eee5 reply state 0000000040900fd5 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.699360:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.699383:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.699386:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448460.699390:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448460.699476:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:11386:x1875323801104000:12345-192.168.206.21@tcp:36:bash.0 Request processed in 442us (645us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788448460.699483:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 117 00000020:00080000:3.0:1788448460.699489:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788448460.709246:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.709500:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801104128 00000100:00100000:3.0:1788448460.709509:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801104128 00000100:00100000:3.0:1788448460.709569:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:3.0:1788448460.709580:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:11386:x1875323801104128:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448460.709605:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448460.709624:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f66 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0727 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.709709:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.709723:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.709731:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.709764:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 59 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.709778:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 59 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.709818:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826350848:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448460.709952:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448460.714013:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826350848:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448460.714045:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448460.714281:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.714397:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801104256 00000100:00100000:3.0:1788448460.714405:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801104256 00010000:00010000:3.0:1788448460.714435:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.714473:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:3.0:1788448460.714481:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:2399:x1875323801104256:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448460.714496:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448460.714502:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.714514:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.714535:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b803f43 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0719 expref: 60 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.714550:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.714555:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.714576:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.714583:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.714608:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448460.714657:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:2399:x1875323801104256:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 176us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.714664:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00010000:00010000:0.0:1788448460.714761:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.714769:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448460.714828:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788448460.714832:0:13810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448460.714850:0:13810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.714917:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f66 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 59 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.714932:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 58 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.714939:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448460.714941:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448460.714951:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:0.0:1788448460.714978:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:11386:x1875323801104128:12345-192.168.206.21@tcp:101:bash.0 Request processed in 5401us (5743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.714985:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:1.0:1788448460.719309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.724409:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801104512 00000100:00100000:0.0:1788448460.724422:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801104512 00000100:00100000:0.0:1788448460.724582:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:0.0:1788448460.724592:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:11386:x1875323801104512:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:0.0:1788448460.724794:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:11386:x1875323801104512:12345-192.168.206.21@tcp:35:bash.0 Request processed in 203us (5493us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788448460.724810:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00010000:00010000:3.0:1788448460.799239:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448460.815536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.816238:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801104640 00000100:00100000:2.0:1788448460.816249:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801104640 00000100:00100000:2.0:1788448460.816310:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:2.0:1788448460.816320:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:11392:x1875323801104640:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448460.816342:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448460.816361:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e072e expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.816419:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803f7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.816432:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.816444:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448460.816488:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788448460.816492:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448460.816508:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803f7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.816543:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e072e expref: 61 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.816562:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803f7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e072e expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.816571:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448460.816574:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448460.816577:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331000, rc 0) 00000100:00100000:2.0:1788448460.816639:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:11392:x1875323801104640:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 320us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448460.816647:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:1.0:1788448460.821509:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.821627:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801104768 00000100:00100000:3.0:1788448460.821636:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801104768 00000100:00100000:3.0:1788448460.821690:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:3.0:1788448460.821700:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:11392:x1875323801104768:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448460.821720:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448460.821738:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803f82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0735 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822126:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822142:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822153:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822165:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822185:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822203:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822274:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822283:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822290:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448460.822327:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788448460.822332:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448460.822348:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822359:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822423:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822431:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822437:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822453:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448460.822458:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822465:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822477:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:3.0:1788448460.822480:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448460.822484:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822490:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b803f89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822502:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822508:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822513:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822517:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448460.822520:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822526:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822544:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:3.0:1788448460.822546:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448460.822549:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822554:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b803f90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b803f82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822593:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.822600:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.822603:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448460.822605:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:3.0:1788448460.822715:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11392:x1875323801104768:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1015us (1213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.822722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:0.0:1788448460.832457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.832552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.832641:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105152 00000100:00100000:2.0:1788448460.832649:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105152 00000100:00100000:2.0:1788448460.832706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:2.0:1788448460.832717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11392:x1875323801105152:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448460.832737:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448460.832756:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e073c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.832852:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.832867:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.832876:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.832927:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.832957:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.832970:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 62 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.832982:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826350976:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448460.833076:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.833085:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.833092:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d51500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826351104:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448460.833111:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1922ab3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448460.833600:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105024 00000100:00100000:3.0:1788448460.833605:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105024 00010000:00010000:3.0:1788448460.833629:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 63 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.833659:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:3.0:1788448460.833667:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:2400:x1875323801105024:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448460.833688:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448460.833694:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 63 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.833706:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 63 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.833723:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.833728:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.833734:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.833739:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448460.833764:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:2400:x1875323801105024:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 98us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.833771:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:1.0:1788448460.845459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788448460.845554:0:6517:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.21@tcp) returned -22 from blocking AST (req@00000000ab4a54f6 x1875323826350976) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 62 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.845576:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b803f97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0735 expref: 62 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448460.845594:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826350976:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448460.845623:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d51500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826351104:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448460.845641:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448460.845646:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.845655:0:6517:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.845663:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.845775:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105280 00000100:00100000:3.0:1788448460.845795:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105280 00010000:00010000:3.0:1788448460.845828:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448460.845865:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1788448460.845875:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:2399:x1875323801105280:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448460.845920:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448460.845926:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.845947:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.845964:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b803f6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0727 expref: 62 pid: 13810 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.845974:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.845978:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.845985:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.845992:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.846022:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448460.846123:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.846131:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448460.846148:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788448460.846277:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b803f9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.846292:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.846299:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448460.846302:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788448460.846312:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331800, rc 0) 00000100:00100000:3.0:1788448460.846582:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:2399:x1875323801105280:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 706us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.846592:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:0.0:1788448460.849147:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11392:x1875323801105152:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 16421us (16583us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788448460.849159:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:1.0:1788448460.859926:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448460.860202:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105536 00000100:00100000:3.0:1788448460.860212:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105536 00000100:00100000:3.0:1788448460.860274:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1788448460.860285:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11392:x1875323801105536:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:3.0:1788448460.860300:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448460.860326:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803ef6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e070b expref: 61 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448460.860360:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:3.0:1788448460.860365:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448460.860419:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:11392:x1875323801105536:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 135us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448460.860426:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1788448460.866598:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448460.866701:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105664 00000100:00100000:2.0:1788448460.866710:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105664 00000100:00100000:2.0:1788448460.866769:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:2.0:1788448460.866789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:11392:x1875323801105664:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:2.0:1788448460.866917:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.866933:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448460.866944:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448460.867031:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788448460.867122:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:11392:x1875323801105664:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 342us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448460.867129:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:1.0:1788448460.869185:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448460.869274:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105792 00000100:00100000:0.0:1788448460.869282:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105792 00000100:00100000:0.0:1788448460.869336:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1788448460.869345:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:11392:x1875323801105792:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448460.869362:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448460.869381:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0743 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.869427:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.869438:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 61 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.869457:0:9023:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.869470:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 61 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.869483:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448460.869486:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448460.869490:0:9023:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 61 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448460.869516:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e200, rc 0) 00000100:00100000:0.0:1788448460.869571:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11392:x1875323801105792:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 226us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448460.869579:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00000040:00080000:0.0:1788448461.246435:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448461.246444:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448461.246470:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788448461.246478:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448461.246610:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826351232:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448461.246727:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448461.252177:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826351232:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788448461.253303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.253521:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801105920 00000100:00100000:0.0:1788448461.253532:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801105920 00000100:00100000:0.0:1788448461.253602:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:0.0:1788448461.253613:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11393:x1875323801105920:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448461.253645:0:13810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448461.253915:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11393:x1875323801105920:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 303us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.253924:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:1.0:1788448461.271804:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.271923:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801106048 00000100:00100000:2.0:1788448461.271944:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801106048 00000100:00100000:2.0:1788448461.272008:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:2.0:1788448461.272018:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11393:x1875323801106048:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788448461.272086:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272103:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272128:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272153:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272161:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272168:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272201:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272220:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272227:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448461.272272:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788448461.272276:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448461.272295:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272307:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272313:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272318:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272324:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.272328:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272334:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272345:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:2.0:1788448461.272348:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448461.272352:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272357:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b803fc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272369:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272374:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272380:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272393:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.272396:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272401:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272408:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9fc1bb543e00) 00010000:00010000:2.0:1788448461.272410:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448461.272413:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272419:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803fc8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272434:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272440:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272445:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272450:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.272452:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272457:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272473:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448461.272475:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448461.272479:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.272484:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803fcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.272559:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11393:x1875323801106048:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 541us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.272566:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:1.0:1788448461.283282:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.290386:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801106304 00000100:00100000:0.0:1788448461.290404:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801106304 00000100:00100000:0.0:1788448461.290491:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:0.0:1788448461.290505:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:11393:x1875323801106304:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448461.290529:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448461.290569:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803fd6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e074a expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290678:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290694:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290706:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448461.290718:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788448461.290803:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290811:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290817:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290823:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448461.290827:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290834:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290847:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448461.290850:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448461.290855:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290870:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b803fdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290936:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803fd6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e074a expref: 63 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290946:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:0.0:1788448461.290948:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448461.290952:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b803fd6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e074a expref: 63 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.290960:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f800, rc 0) 00000100:00100000:0.0:1788448461.291030:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:11393:x1875323801106304:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 527us (7756us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1788448461.291038:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:0.0:1788448461.298291:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.298375:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801106432 00000100:00100000:2.0:1788448461.298386:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801106432 00000100:00100000:2.0:1788448461.298449:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:2.0:1788448461.298460:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:11393:x1875323801106432:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448461.298513:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448461.298621:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:11393:x1875323801106432:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 162us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.298630:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:3.0:1788448461.311250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.311375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801106688 00000100:00100000:2.0:1788448461.311391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801106688 00000100:00100000:2.0:1788448461.311476:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:2.0:1788448461.311487:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:11393:x1875323801106688:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448461.311508:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448461.311511:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788448461.311537:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b803f7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e072e expref: 62 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.311573:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:2.0:1788448461.311578:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448461.311591:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803feb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0751 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448461.312036:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788448461.312453:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ff2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.312469:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.312479:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.312529:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b803feb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0751 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.312545:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0751 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.312552:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc1bb543e00) 00010000:00010000:2.0:1788448461.312555:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448461.312557:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330200, rc 0) 00000100:00100000:2.0:1788448461.312744:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:11393:x1875323801106688:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1257us (1508us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788448461.312752:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:1.0:1788448461.329011:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.332262:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801106944 00000100:00100000:0.0:1788448461.332283:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801106944 00000100:00100000:0.0:1788448461.332382:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:0.0:1788448461.332398:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:11393:x1875323801106944:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448461.332482:0:9023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448461.332516:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b803ff2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0751 expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.332541:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc1bb543e00) 00010000:00010000:0.0:1788448461.332555:0:9023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448461.332602:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.332681:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.332694:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333124:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333145:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333157:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333218:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333225:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333232:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333237:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448461.333241:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333246:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333276:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448461.333279:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448461.333284:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333290:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804000 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333305:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333311:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333316:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333321:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448461.333324:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333329:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333336:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x57c20996 (ffff9fc08336a900) 00010000:00010000:0.0:1788448461.333338:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448461.333340:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.333345:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b804007 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x57c20996 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.333730:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:11393:x1875323801106944:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1330us (4726us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448461.333741:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:2.0:1788448461.349286:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.349519:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801107072 00000100:00100000:0.0:1788448461.349531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801107072 00000100:00100000:0.0:1788448461.349589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:0.0:1788448461.349599:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:11393:x1875323801107072:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448461.349620:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448461.349642:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b80400e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0758 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.349676:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.349688:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.349698:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.349801:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b80400e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 64 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.349819:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.349828:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:0.0:1788448461.349838:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448461.349842:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448461.349947:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:11393:x1875323801107072:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 349us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.349955:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 130 00000100:00100000:3.0:1788448461.355392:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.355636:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801107328 00000100:00100000:1.0:1788448461.355646:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801107328 00000100:00100000:1.0:1788448461.355707:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:1.0:1788448461.355728:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:11393:x1875323801107328:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448461.355813:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.355830:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.355842:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448461.356052:0:13811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788448461.356068:0:13811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378701185583ns, next at 379701177371ns, rc = 0 00000004:00010000:1.0:1788448461.356116:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0a157ff reply state 00000000885a9523 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.356128:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.356136:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:1.0:1788448461.356139:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788448461.356143:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448461.356238:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:11393:x1875323801107328:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 520us (856us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788448461.356245:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:1.0:1788448461.362647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.362742:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801107456 00000100:00100000:2.0:1788448461.362753:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801107456 00000100:00100000:2.0:1788448461.362811:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:2.0:1788448461.362820:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:11393:x1875323801107456:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448461.362841:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448461.362860:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e075f expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.363168:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.363183:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.363209:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:2.0:1788448461.363211:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448461.363215:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331600, rc 0) 00000100:00100000:2.0:1788448461.363271:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:11393:x1875323801107456:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 451us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.363279:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:3.0:1788448461.367632:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.367841:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801107584 00000100:00100000:1.0:1788448461.367867:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801107584 00000100:00100000:1.0:1788448461.368065:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:1.0:1788448461.368184:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801107584:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788448461.368439:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801107584:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 365us (995us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788448461.368459:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00080000:2.0:1788448461.368665:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448461.377820:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.377923:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801107840 00000100:00100000:2.0:1788448461.377954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801107840 00000100:00100000:2.0:1788448461.378023:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1788448461.378033:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:11393:x1875323801107840:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448461.378242:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:11393:x1875323801107840:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 210us (430us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788448461.378264:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:0.0:1788448461.381385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.381644:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108096 00000100:00100000:2.0:1788448461.381653:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108096 00000100:00100000:2.0:1788448461.381718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:2.0:1788448461.381729:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:11393:x1875323801108096:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788448461.381851:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:11393:x1875323801108096:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 124us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.381860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:3.0:1788448461.392400:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.392480:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108224 00000100:00100000:1.0:1788448461.392490:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108224 00000100:00100000:1.0:1788448461.392547:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:1.0:1788448461.392557:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:11393:x1875323801108224:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448461.392575:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448461.392592:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b80402a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0766 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.392654:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804031 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.392668:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.392678:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448461.392716:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448461.392733:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804031 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.392756:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b80402a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0766 expref: 69 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.392785:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804031 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0766 expref: 68 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.392794:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:1.0:1788448461.392797:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788448461.392801:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030e00, rc 0) 00000100:00100000:1.0:1788448461.393797:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:11393:x1875323801108224:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 842us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448461.393810:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:1.0:1788448461.406623:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.406724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108352 00000100:00100000:0.0:1788448461.406735:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108352 00000100:00100000:0.0:1788448461.406789:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:0.0:1788448461.406800:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801108352:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448461.406816:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448461.406835:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e076d expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448461.406859:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998ecd, blocks: 0x0 00010000:00010000:0.0:1788448461.406878:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1788448461.407095:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448461.407105:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.407124:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 10 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.407137:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ec00, rc 0) 00000100:00100000:0.0:1788448461.407244:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2399:x1875323801108352:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 445us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.407269:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:3.0:1788448461.412849:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.415041:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108608 00000100:00100000:0.0:1788448461.415054:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108608 00000100:00100000:0.0:1788448461.415135:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:0.0:1788448461.415147:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:11393:x1875323801108608:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448461.415265:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:11393:x1875323801108608:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 120us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.415273:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:3.0:1788448461.423861:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.424174:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108736 00000100:00100000:1.0:1788448461.424184:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108736 00000100:00100000:1.0:1788448461.424246:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:1.0:1788448461.424258:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:11393:x1875323801108736:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448461.424274:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448461.424292:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0774 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.424321:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.424329:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448461.424333:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448461.424338:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.424394:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.424408:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448461.424421:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826351360:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448461.424521:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448461.432547:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826351360:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448461.432586:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.432607:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031e00, rc 0) 00000100:00100000:3.0:1788448461.432665:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:11393:x1875323801108736:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 8408us (8812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448461.432674:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1788448461.438466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448461.438552:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108864 00000100:00100000:3.0:1788448461.438562:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108864 00010000:00010000:3.0:1788448461.438602:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.438662:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:3.0:1788448461.438672:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2398:x1875323801108864:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448461.438686:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448461.438707:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.438721:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.438743:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4ca1346/0xf45a9e4e6b804038 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e076d expref: 11 pid: 8433 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.438759:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448461.438764:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448461.438771:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 10 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.438780:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 10 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.438815:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 10 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.438830:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1875323826351488:192.168.206.21@tcp:105: 00000100:00100000:3.0:1788448461.439122:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08254db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448461.450261:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6503:1875323826351488:192.168.206.21@tcp:105: 00010000:00010000:0.0:1788448461.450317:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448461.450382:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2398:x1875323801108864:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 11711us (11924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.450394:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:1.0:1788448461.451530:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.452225:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801108992 00000100:00100000:0.0:1788448461.452236:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801108992 00002000:00100000:0.0:1788448461.452284:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9fc083e4e300 x1875323801108992/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:697/0 lens 504/0 e 0 to 0 dl 1788448472 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448461.452296:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083e4e300 with x1875323801108992 ext(0->12) 00002000:00010000:0.0:1788448461.452301:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc083e4e300 00000100:00100000:0.0:1788448461.452333:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:0.0:1788448461.452344:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2398:x1875323801108992:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788448461.455527:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:2398:x1875323801108992:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 3172us (3990us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788448461.455541:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00002000:00100000:0.0:1788448461.455569:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9fc083e4e300 x1875323801108992/t4294967309(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:697/0 lens 504/448 e 0 to 0 dl 1788448472 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448461.455580:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083e4e300 with x1875323801108992 ext(0->12) 00002000:00010000:0.0:1788448461.455586:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc083e4e300 00000100:00100000:1.0:1788448461.459726:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.460157:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801109120 00000100:00100000:2.0:1788448461.460167:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801109120 00000100:00100000:2.0:1788448461.460239:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:2.0:1788448461.460250:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:11393:x1875323801109120:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788448461.464080:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1788448461.464112:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788448461.464177:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788448461.464220:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc1ba2cb240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788448461.464225:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc183f4fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1ba2cbd80 00000020:00080000:0.0:1788448461.464228:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc183f4f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1b5d2f800 00000004:00080000:0.0:1788448461.464279:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788448461.464304:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc083764780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788448461.464308:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083187600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083764d80 00000020:00080000:0.0:1788448461.464311:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083187400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc082746a00 00000100:00100000:3.0:1788448461.464325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826351744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788448461.464388:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448461.464527:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448461.464540:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826351872:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788448461.464660:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11393:x1875323801109120:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 4410us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.464670:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:3.0:1788448461.465383:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448461.465392:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826351616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788448461.465423:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448461.471014:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448461.472831:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826351744 00000100:00100000:0.0:1788448461.472844:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826351744 00000100:00100000:0.0:1788448461.473025:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826351616 00000100:00100000:0.0:1788448461.473030:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826351616 00000100:00100000:0.0:1788448461.473055:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788448461.473066:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826351744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788448461.473202:0:8431:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788448461.473206:0:8431:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788448461 00002000:00010000:0.0:1788448461.473209:0:8431:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788448461.473211:0:8431:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788448461 -> 1788448461 00002000:00010000:0.0:1788448461.473213:0:8431:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788448461.473281:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1875323826351744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 216us (8892us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788448461.473301:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788448461.473319:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788448461.473326:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826351616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788448461.473340:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1788448461.473356:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.473377:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.473385:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788448461.473390:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448461.473394:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.473428:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 11 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473482:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473491:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473498:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473504:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448461.473508:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473515:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473530:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9fc1bb42be00) 00010000:00010000:1.0:1788448461.473540:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448461.473545:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473552:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b803d44 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473574:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473581:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.473583:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 11 pid: 8434 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473596:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.473599:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875323826352000:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448461.473601:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448461.473604:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473609:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473616:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9fc1bb42bf00) 00010000:00010000:1.0:1788448461.473619:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448461.473621:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473626:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b803dec lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473639:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473654:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473660:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.473662:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969776c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788448461.473665:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448461.473668:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473673:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473680:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:1.0:1788448461.473683:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448461.473685:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473690:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b803e6a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473701:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473707:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473712:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473716:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448461.473735:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473741:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473749:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543100) 00010000:00010000:1.0:1788448461.473751:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448461.473754:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473759:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b803e8d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473774:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473780:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473785:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448461.473787:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083e20700/2, rc 0, transno 4294967310 00010000:00010000:1.0:1788448461.473789:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448461.473791:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.473794:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826351744:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1788448461.473797:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473804:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:1.0:1788448461.473806:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448461.473808:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826351872 00000100:00100000:3.0:1788448461.473812:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826351872 00010000:00010000:1.0:1788448461.473814:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473819:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b803f5f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.473831:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1788448461.473831:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.473837:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875323826351872:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788448461.473837:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473843:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473848:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031a00 already unused, calling callback (ffffffffc17794f0) 00002000:00080000:3.0:1788448461.473850:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:1.0:1788448461.473851:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473856:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473863:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:1.0:1788448461.473865:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788448461.473868:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.473874:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80401c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448461.473898:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a998ecb, atime: 0x6a998ecc, ctime: 0x6a998ecb, blocks: 0x8 00010000:00010000:3.0:1788448461.473905:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.473914:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1788448461.473918:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448461.473923:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448461.473923:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00010000:00010000:3.0:1788448461.473936:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.473954:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.473961:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788448461.473965:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00010000:00010000:3.0:1788448461.473980:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448461.473992:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448461.474002:0:9523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.474008:0:9523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448461.474011:0:9523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.474018:0:9523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.474030:0:9523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.474037:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b80404d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.474049:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448461.474052:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448461.474053:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448461.474087:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3648:x1875323826351872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 249us (3081us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788448461.474094:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1788448461.474288:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083d50380/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788448461.474294:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826351872:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788448461.474361:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448461.480111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448461.480207:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801109248 00000100:00100000:3.0:1788448461.480217:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801109248 00000100:00100000:3.0:1788448461.480275:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:3.0:1788448461.480287:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:2399:x1875323801109248:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788448461.480682:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875323826352000:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448461.480706:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.483368:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448461.483574:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801109376 00000100:00100000:3.0:1788448461.483583:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801109376 00010000:00010000:3.0:1788448461.483619:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 13 pid: 8434 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.483658:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:3.0:1788448461.483668:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:2399:x1875323801109376:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448461.483682:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448461.483688:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 13 pid: 8434 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.483718:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 13 pid: 8434 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.483740:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf720b89/0xf45a9e4e6b803dfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06cc expref: 13 pid: 8434 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.483756:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448461.483760:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448461.483766:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.483775:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.483804:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448461.483860:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:2399:x1875323801109376:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 193us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448461.484392:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00010000:00010000:2.0:1788448461.484645:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.484656:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.484679:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.484687:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.484710:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448461.485007:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448461.485014:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.485022:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448461.485027:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.485036:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.485049:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.485056:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000835f9471/0xf45a9e4e6b804046 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.485077:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448461.485079:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448461.485080:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448461.485225:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3646:x1875323826351616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11546us (19447us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788448461.485235:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000001:00080000:2.0:1788448461.486828:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788448461.486839:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000004:00080000:3.0:1788448461.487380:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083e21f80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788448461.487390:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826351616:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788448461.487687:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801109248:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 7400us (7582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.487696:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1788448461.492707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.492856:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801109632 00000100:00100000:1.0:1788448461.492866:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801109632 00000100:00100000:1.0:1788448461.492957:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:1.0:1788448461.492967:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11393:x1875323801109632:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448461.493020:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448461.493057:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804031 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0766 expref: 16 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.493090:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:1.0:1788448461.493095:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448461.493125:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.493138:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.493147:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448461.493263:0:6519:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000075d51f84 reply state 00000000eaa48396 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.493274:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.493280:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:1.0:1788448461.493283:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448461.493285:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448461.493375:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11393:x1875323801109632:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 409us (677us total) trans 4294967403 rc 0/0 00000100:00100000:1.0:1788448461.493383:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:1.0:1788448461.501591:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.501682:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801109760 00000100:00100000:2.0:1788448461.501692:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801109760 00000100:00100000:2.0:1788448461.501746:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448461.501757:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801109760:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788448461.501923:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788448461.501927:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788448461 -> 1788448460 00002000:00010000:2.0:1788448461.501929:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788448460 00002000:00010000:2.0:1788448461.501931:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788448461 -> 1788448460 00002000:00010000:2.0:1788448461.501933:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788448461.501990:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801109760:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 234us (406us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788448461.501998:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448461.507122:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.507326:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110016 00000100:00100000:0.0:1788448461.507335:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110016 00000100:00100000:0.0:1788448461.507401:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:0.0:1788448461.507410:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:11393:x1875323801110016:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788448461.507472:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.507489:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.507498:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.507530:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.507544:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 17 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.507557:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826352128:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448461.507646:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448461.511000:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.511136:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110144 00000100:00100000:2.0:1788448461.511145:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110144 00010000:00010000:2.0:1788448461.511183:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 18 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.511235:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:2.0:1788448461.511245:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2398:x1875323801110144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448461.511260:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448461.511267:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 18 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.511289:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 18 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.511312:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:2.0:1788448461.511317:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.511327:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.511335:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.511352:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448461.511409:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2398:x1875323801110144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 165us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.511416:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00010000:00010000:0.0:1788448461.511744:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804015 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0758 expref: 17 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.511760:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826352128:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448461.511781:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511790:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511806:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511842:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511849:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511856:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511861:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448461.511866:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511872:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511935:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:0.0:1788448461.511938:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788448461.511942:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.511948:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b80405b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.511989:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11393:x1875323801110016:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 4579us (4874us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788448461.511997:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:3.0:1788448461.515179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.515338:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110272 00000100:00100000:2.0:1788448461.515347:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110272 00000100:00100000:2.0:1788448461.515401:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:2.0:1788448461.515411:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801110272:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788448461.515455:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.515477:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.515485:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448461.515490:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448461.515495:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.515529:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.515543:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 7 pid: 8539 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.515557:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875323826352256:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448461.515630:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448461.517786:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875323826352256:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448461.517815:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.519480:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.519552:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110400 00000100:00100000:0.0:1788448461.519560:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110400 00010000:00010000:0.0:1788448461.519596:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 8 pid: 8539 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.519635:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:0.0:1788448461.519644:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801110400:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448461.519657:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448461.519677:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 8 pid: 8539 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.519691:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 8 pid: 8539 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.519712:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006582cad3/0xf45a9e4e6b80403f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0774 expref: 8 pid: 8539 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.519727:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448461.519731:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448461.519737:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.519746:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.519778:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448461.519828:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801110400:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 184us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.519846:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00010000:00010000:2.0:1788448461.520254:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520265:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520284:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520292:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520301:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520307:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448461.520312:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520320:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520331:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.520350:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a413a2c/0xf45a9e4e6b804062 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.520410:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801110272:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 5000us (5239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.520418:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1788448461.525923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.526173:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110656 00000100:00100000:0.0:1788448461.526183:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110656 00000100:00100000:0.0:1788448461.526247:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:0.0:1788448461.526258:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:11393:x1875323801110656:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448461.526327:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.526343:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 16 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.526353:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.526384:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 16 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.526397:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 16 pid: 13811 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.526411:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826352384:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448461.526478:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969776c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448461.529785:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826352384:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448461.529813:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.530564:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.530641:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110784 00000100:00100000:2.0:1788448461.530649:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110784 00010000:00010000:2.0:1788448461.530687:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 17 pid: 13811 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.530727:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:2.0:1788448461.530736:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:2399:x1875323801110784:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448461.530749:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448461.530755:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 17 pid: 13811 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.530773:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 17 pid: 13811 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.530794:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b803f58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0720 expref: 17 pid: 13811 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.530811:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448461.530817:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 16 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.530833:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.530841:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.530848:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531059:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531079:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531232:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531244:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531253:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531289:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.531302:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.531316:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826352512:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448461.531389:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977180 going to sleep for 11 seconds 00010000:00010000:2.0:1788448461.531750:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448461.531822:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:2399:x1875323801110784:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1085us (1261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.531830:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:1.0:1788448461.541710:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448461.541977:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826352512:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448461.542011:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.542137:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801110912 00000100:00100000:2.0:1788448461.542149:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801110912 00010000:00010000:2.0:1788448461.542195:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.542229:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:2.0:1788448461.542240:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:2398:x1875323801110912:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448461.542254:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448461.542260:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.542273:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.542325:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b804023 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e075f expref: 17 pid: 6518 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.542341:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:2.0:1788448461.542347:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.542356:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.542364:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.542394:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448461.542445:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:2398:x1875323801110912:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 207us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.542453:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00010000:00010000:3.0:1788448461.542640:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.542648:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448461.551486:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788448461.551630:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788448461.551666:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788448461.551762:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13810:1875323826352640:0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788448461.551839:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448461.551911:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969779c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448461.552031:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826352640 00000100:00100000:2.0:1788448461.552039:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826352640 00000100:00100000:2.0:1788448461.552090:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788448461.552099:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13810:x1875323826352640:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788448461.552171:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13810:x1875323826352640:12345-0@lo:1000:mdt00_004.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.552178:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788448461.552227:0:13810:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788448461.552232:0:13810:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788448461.552250:0:13810:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083e20700, transno 4294967310 00000100:00100000:2.0:1788448461.552272:0:13810:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc083e21f80 x1875323826351616/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788448477 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448461.552284:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08373dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13810:1875323826352640:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788448461.552389:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1788448461.552429:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13810:1875323826352768:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788448461.552466:0:13810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448461.552485:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826352768 00000100:00100000:2.0:1788448461.552488:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826352768 00000100:00100000:2.0:1788448461.552506:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788448461.552511:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:13810:x1875323826352768:12345-0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788448461.552596:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:13810:x1875323826352768:12345-0@lo:1000:mdt00_004.0 Request processed in 84us (130us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788448461.552603:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788448461.552619:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448461.552635:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c1500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:13810:1875323826352768:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788448461.552662:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552672:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552680:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552687:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.552692:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552709:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552724:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:2.0:1788448461.552727:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448461.552731:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552737:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804070 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552757:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552763:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552769:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552774:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.552777:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552782:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552789:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448461.552791:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448461.552797:0:13810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 19 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552819:0:13810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 19 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552828:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 19 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.552851:0:13810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 19 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.552862:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826352896:192.168.206.21@tcp:105: 00000100:00100000:2.0:1788448461.552954:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448461.557332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.557398:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801111040 00000100:00100000:1.0:1788448461.557406:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801111040 00000100:00100000:1.0:1788448461.557453:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1788448461.557475:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11392:x1875323801111040:12345-192.168.206.21@tcp:49:lfs.0 00000100:00100000:1.0:1788448461.557581:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:11392:x1875323801111040:12345-192.168.206.21@tcp:49:lfs.0 Request processed in 107us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448461.557588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:3.0:1788448461.557832:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826352896:192.168.206.21@tcp:105: 00010000:00010000:3.0:1788448461.557859:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.557870:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b803fb3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.558996:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559016:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559027:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559038:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559045:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559051:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559084:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.559088:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559095:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559108:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448461.559111:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448461.559115:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559121:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804077 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559133:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559139:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559144:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559149:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448461.559151:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559157:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559175:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448461.559177:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448461.559180:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.559196:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804069 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.559368:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11393:x1875323801110656:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 33109us (33500us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788448461.559377:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 139 00000020:00080000:2.0:1788448461.559382:0:13810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788448461.559582:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448461.559587:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448461.560238:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788448461.560248:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448461.562614:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448461.563028:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801111296 00000100:00100000:1.0:1788448461.563036:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801111296 00000100:00100000:1.0:1788448461.563230:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:1.0:1788448461.563251:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:11393:x1875323801111296:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788448461.563490:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788448461.563519:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1788448461.563551:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.563565:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.563576:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.563584:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448461.563682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.563749:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801111552 00000100:00100000:2.0:1788448461.563754:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801111552 00000100:00100000:2.0:1788448461.563824:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:2.0:1788448461.563833:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11392:x1875323801111552:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:1.0:1788448461.563843:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.563849:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448461.563901:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:2.0:1788448461.563959:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788448461.564029:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11392:x1875323801111552:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 197us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448461.564029:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11393:x1875323801111296:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 789us (1423us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788448461.564037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:1.0:1788448461.564037:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000020:00080000:1.0:1788448461.564042:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788448461.564139:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448461.564146:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.564152:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448461.564156:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.564164:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.564176:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:3.0:1788448461.564179:0:6505:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788448461.564193:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.564199:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80407e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448461.564224:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448461.564226:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448461.564227:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448461.596736:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.596825:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801111680 00000100:00100000:2.0:1788448461.596835:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801111680 00000100:00100000:2.0:1788448461.597042:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:2.0:1788448461.597053:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:11395:x1875323801111680:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448461.597087:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448461.597105:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804085 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e077b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597198:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597212:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597224:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597239:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597246:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597253:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597551:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597565:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597575:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597608:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.597635:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 22 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.597649:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875323826353024:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448461.597783:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448461.604561:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.605193:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875323826353024:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448461.605221:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448461.605357:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801111936 00000100:00100000:0.0:1788448461.605364:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801111936 00000100:00100000:0.0:1788448461.605423:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:0.0:1788448461.605434:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:6169:x1875323801111936:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788448461.605640:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:6169:x1875323801111936:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 207us (1087us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788448461.605647:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1788448461.608463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448461.608642:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801112064 00000100:00100000:2.0:1788448461.608651:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801112064 00010000:00010000:2.0:1788448461.608685:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 24 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448461.608722:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:2.0:1788448461.608732:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:2398:x1875323801112064:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448461.608744:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448461.608751:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 24 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.608764:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 24 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.608785:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b803fa5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e073c expref: 24 pid: 6517 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.608817:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448461.608822:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.608831:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.608838:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448461.608872:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448461.608968:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:2398:x1875323801112064:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 237us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.608976:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00010000:00010000:0.0:1788448461.613046:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613063:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448461.613116:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788448461.613121:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448461.613139:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613154:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613164:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613170:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613205:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613211:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448461.613214:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613222:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613236:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:0.0:1788448461.613239:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448461.613244:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613250:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331600/0xf45a9e4e6b80408c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613266:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613272:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613289:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613295:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448461.613297:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613314:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613323:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9fc1bb543800) 00010000:00010000:0.0:1788448461.613325:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448461.613329:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613334:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804093 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613377:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804085 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e077b expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613392:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e077b expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448461.613400:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448461.613402:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448461.613404:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331200, rc 0) 00000100:00100000:0.0:1788448461.613481:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11395:x1875323801111680:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 16430us (16753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.613491:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 141 00010000:00010000:3.0:1788448461.825346:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788448461.888463:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1788448461.888484:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000040:00080000:1.0:1788448462.302120:0:14264:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448462.302130:0:14264:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448462.302168:0:14264:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788448462.302173:0:14264:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448462.526129:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826353152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448462.526212:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448462.526365:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826353152 00000100:00100000:3.0:1788448462.526374:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826353152 00000100:00100000:3.0:1788448462.526437:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788448462.526447:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826353152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448462.526469:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788448462.526531:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826353152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448462.526538:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788448462.526566:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826353280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448462.526596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448462.526754:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826353280 00000100:00100000:2.0:1788448462.526759:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826353280 00000100:00100000:2.0:1788448462.526870:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788448462.526878:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826353280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448462.526925:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788448462.527066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826353280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 189us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448462.527074:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788448462.527164:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826353152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448462.527257:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826353408:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448462.527284:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448462.527375:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826353280:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448462.532360:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826353408 00000100:00100000:0.0:1788448462.532393:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826353408 00000100:00100000:0.0:1788448462.532662:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788448462.532671:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826353408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448462.532696:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788448462.532791:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826353408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (5506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448462.532797:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788448462.533056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826353408:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788448462.533124:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788448462.590197:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448462.590206:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448462.590246:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788448462.590257:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448462.590384:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826353536:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788448462.590505:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448462.596808:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826353536:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448462.599443:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448462.599540:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801112192 00000100:00100000:2.0:1788448462.599548:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801112192 00000100:00100000:2.0:1788448462.599629:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:2.0:1788448462.599639:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11407:x1875323801112192:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448462.599693:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448462.599821:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11407:x1875323801112192:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 183us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448462.599829:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00080000:0.0:1788448462.599902:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448462.607453:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448462.607561:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801112448 00000100:00100000:0.0:1788448462.607572:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801112448 00000100:00100000:0.0:1788448462.607632:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:0.0:1788448462.607643:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:11407:x1875323801112448:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448462.607661:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448462.607683:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040a1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0782 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.607803:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8040a8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.607818:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8040a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.607829:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8040a8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448462.607840:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788448462.608003:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040a1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0782 expref: 25 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.608037:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8040a8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0782 expref: 24 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.608046:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448462.608049:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448462.608052:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448462.608114:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11407:x1875323801112448:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 473us (672us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788448462.608124:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:1.0:1788448462.622815:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448462.622862:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448462.623070:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801112704 00000100:00100000:0.0:1788448462.623080:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801112704 00000100:00100000:0.0:1788448462.623133:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:0.0:1788448462.623144:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11407:x1875323801112704:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448462.623228:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623246:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623259:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623398:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623407:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623432:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623438:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448462.623443:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623451:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623464:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448462.623467:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448462.623471:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448462.623477:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b8040b6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448462.623590:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:11407:x1875323801112704:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 447us (785us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788448462.623598:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 144 00000040:00080000:3.0:1788448462.623976:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448462.623981:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448462.624500:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788448462.624509:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448462.624852:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801112832 00000100:00100000:2.0:1788448462.624859:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801112832 00000100:00100000:2.0:1788448462.624922:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448462.624931:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:2399:x1875323801112832:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448462.624955:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448462.624975:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8040a8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0782 expref: 25 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448462.624989:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:2.0:1788448462.624993:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448462.625027:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:2399:x1875323801112832:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 98us (2164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448462.625034:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:1.0:1788448462.630418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448462.633194:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113088 00000100:00100000:0.0:1788448462.633209:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113088 00000100:00100000:0.0:1788448462.633285:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:0.0:1788448462.633296:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:11407:x1875323801113088:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448462.633920:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:11407:x1875323801113088:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 622us (3507us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788448462.633929:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00010000:00010000:1.0:1788448462.847214:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448463.871473:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788448464.189600:0:14315:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448464.189611:0:14315:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448464.189654:0:14315:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788448464.189661:0:14315:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788448464.323373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.323561:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113344 00000100:00100000:0.0:1788448464.323574:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113344 00000100:00100000:0.0:1788448464.323703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:0.0:1788448464.323717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:11427:x1875323801113344:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448464.323751:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448464.323776:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8040bd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0789 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.323940:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b8040c4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.323957:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b8040c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.323969:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b8040c4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448464.323982:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000100:00080000:1.0:1788448464.324136:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788448464.324249:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8040bd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0789 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.324270:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b8040c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0789 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.324290:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:0.0:1788448464.324294:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788448464.324298:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351ec00, rc 0) 00000100:00100000:0.0:1788448464.324412:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:11427:x1875323801113344:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 698us (1052us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788448464.324433:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:0.0:1788448464.326818:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448464.327473:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113472 00000100:00100000:1.0:1788448464.327486:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113472 00000100:00100000:1.0:1788448464.327595:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 146 00000100:00100000:1.0:1788448464.327608:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:11427:x1875323801113472:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1788448464.327692:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327712:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327726:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327766:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327774:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327780:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327787:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448464.327792:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327801:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327829:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:1.0:1788448464.327832:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448464.327838:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.327845:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448464.327953:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:11427:x1875323801113472:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 347us (1145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.327962:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 146 00000100:00100000:1.0:1788448464.420418:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448464.420501:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113600 00000100:00100000:2.0:1788448464.420513:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113600 00000100:00100000:2.0:1788448464.420606:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1788448464.420619:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2401:x1875323801113600:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:2.0:1788448464.420643:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448464.420669:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000310d1ba0/0xf45a9e4e6b8040d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0790 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448464.420718:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a998ecc, atime: 0x6a998ecc, ctime: 0x6a998ecc, blocks: 0x8 00010000:00010000:2.0:1788448464.420744:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=381s v=(0 0) 00010000:00010000:2.0:1788448464.420750:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448464.420763:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000310d1ba0/0xf45a9e4e6b8040d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0790 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.420784:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000310d1ba0/0xf45a9e4e6b8040d9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0790 expref: 7 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.420800:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331600, rc 0) 00000100:00100000:2.0:1788448464.420874:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801113600:12345-192.168.206.21@tcp:101:cat.0 Request processed in 257us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.420909:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00080000:1.0:1788448464.421317:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448464.425416:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448464.425503:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113728 00000100:00100000:3.0:1788448464.425529:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113728 00002000:00100000:3.0:1788448464.425590:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9fc083e4c700 x1875323801113728/t0(0) o3->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:700/0 lens 488/0 e 0 to 0 dl 1788448475 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448464.425601:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083e4c700 with x1875323801113728 ext(0->4095) 00002000:00010000:3.0:1788448464.425607:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc083e4c700 00000100:00100000:3.0:1788448464.425645:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:3.0:1788448464.425656:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801113728:12345-192.168.206.21@tcp:3:cat.0 00000100:00100000:3.0:1788448464.425926:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801113728:12345-192.168.206.21@tcp:3:cat.0 Request processed in 270us (522us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788448464.425934:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00002000:00100000:3.0:1788448464.425944:0:8439:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9fc083e4c700 x1875323801113728/t0(0) o3->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:700/0 lens 488/4536 e 0 to 0 dl 1788448475 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448464.425952:0:8439:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083e4c700 with x1875323801113728 ext(0->4095) 00002000:00010000:3.0:1788448464.425956:0:8439:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc083e4c700 00000100:00100000:1.0:1788448464.575447:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826354048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.575538:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448464.575608:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826354560:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.575635:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448464.575651:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826355072:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.575674:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.575869:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826353664:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.575963:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.575998:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826354176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.576045:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826354688:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576065:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.576079:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826355200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.576123:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788448464.576130:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826353792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576187:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.576211:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826354304:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.576257:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826354816:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.576337:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354560 00000100:00100000:2.0:1788448464.576346:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354560 00000100:00100000:2.0:1788448464.576403:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355072 00000100:00100000:2.0:1788448464.576406:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355072 00000100:00100000:2.0:1788448464.576419:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354688 00000100:00100000:2.0:1788448464.576421:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354688 00000100:00100000:2.0:1788448464.576434:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355200 00000100:00100000:2.0:1788448464.576437:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355200 00000100:00100000:2.0:1788448464.576452:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788448464.576462:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826354560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576538:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826354560:12345-0@lo:400:kworker.0 Request processed in 76us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.576546:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788448464.576564:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788448464.576570:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826355072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576595:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826355072:12345-0@lo:400:kworker.0 Request processed in 26us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.576601:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788448464.576611:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788448464.576617:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826354688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576645:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826354688:12345-0@lo:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.576662:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788448464.576673:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788448464.576679:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826355200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576727:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826355200:12345-0@lo:400:kworker.0 Request processed in 48us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.576733:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788448464.576754:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826353664 00000100:00100000:2.0:1788448464.576758:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826353664 00000100:00100000:2.0:1788448464.576785:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788448464.576792:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826353664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576821:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3647:x1875323826353664:12345-0@lo:400:kworker.0 Request processed in 30us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.576827:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788448464.576859:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354176 00000100:00100000:2.0:1788448464.576863:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354176 00000100:00100000:2.0:1788448464.576908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788448464.576915:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826354176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.576949:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826354176:12345-0@lo:400:kworker.0 Request processed in 34us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.576955:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788448464.577115:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826353920:0@lo:400:kworker.0 00000100:00100000:3.0:1788448464.577202:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448464.577244:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826354432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448464.577270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448464.577291:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826354944:0@lo:400:kworker.0 00000100:00100000:3.0:1788448464.577315:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.579040:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354048 00000100:00100000:2.0:1788448464.579056:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354048 00000100:00100000:2.0:1788448464.579111:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826353792 00000100:00100000:2.0:1788448464.579114:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826353792 00000100:00100000:2.0:1788448464.579130:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788448464.579138:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826354048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.579261:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826354048:12345-0@lo:400:kworker.0 Request processed in 123us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.579269:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788448464.579286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354304 00000100:00100000:2.0:1788448464.579289:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354304 00000100:00100000:2.0:1788448464.579308:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354816 00000100:00100000:2.0:1788448464.579312:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354816 00000100:00100000:2.0:1788448464.579326:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354432 00000100:00100000:2.0:1788448464.579330:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354432 00000100:00100000:1.0:1788448464.579506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826355072:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.579540:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826354048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.579554:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826354560:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.579586:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826354944 00000100:00100000:1.0:1788448464.579590:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826354944 00000100:00100000:2.0:1788448464.579640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788448464.579647:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826353792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.579701:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826353792:12345-0@lo:400:kworker.0 Request processed in 54us (3514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.579707:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788448464.579721:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788448464.579727:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826354304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.579756:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826354304:12345-0@lo:400:kworker.0 Request processed in 29us (3520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.579763:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788448464.579773:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788448464.579780:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826354816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.579827:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826354816:12345-0@lo:400:kworker.0 Request processed in 47us (3537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.579834:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788448464.579846:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1788448464.580733:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826353920 00000100:00100000:3.0:1788448464.580947:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826353920 00000100:00100000:3.0:1788448464.580993:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788448464.581001:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826353920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448464.581100:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826353920:12345-0@lo:400:kworker.0 Request processed in 100us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.581108:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788448464.581151:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826353920:0@lo:400:kworker.0 00000100:00080000:3.0:1788448464.581212:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448464.581345:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826353792:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.581362:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826354304:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.581375:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826354816:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.581387:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826353664:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.581400:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826354176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.581414:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826354688:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.581427:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788448464.581434:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967305 00000004:00080000:0.0:1788448464.581460:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc191317100, transno 4294967302 00000004:00080000:0.0:1788448464.581476:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788448464.581490:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083d50380, transno 4294967305 00000100:00100000:0.0:1788448464.581494:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826355200:0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.582408:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:1.0:1788448464.582424:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826354944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448464.582523:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826354944:12345-0@lo:400:kworker.0 Request processed in 103us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.582531:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00080000:1.0:1788448464.582578:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083e9fb80 x1875323826354944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448464.582592:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.585656:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826354432:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788448464.588876:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448464.588961:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448464.588966:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448464.592355:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826354432:12345-0@lo:400:kworker.0 Request processed in 12482us (15063us total) trans 0 rc 0/0 00010000:00080000:1.0:1788448464.592356:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7b4380 x1875323826354432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448464.592376:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:1.0:1788448464.592383:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826354432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.744375:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.744425:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.744458:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.744494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.744524:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.744551:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448464.744588:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801114112 00000100:00100000:0.0:1788448464.744599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801114112 00000100:00100000:1.0:1788448464.744668:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801114368 00000100:00100000:0.0:1788448464.744671:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113984 00000100:00100000:1.0:1788448464.744674:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801114368 00000100:00100000:0.0:1788448464.744692:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113984 00000100:00100000:3.0:1788448464.744742:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801114496 00000100:00100000:3.0:1788448464.744755:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801114496 00000100:00100000:3.0:1788448464.744787:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 313 00000100:00100000:3.0:1788448464.744797:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801114112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448464.744935:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801114112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 138us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.744943:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 313 00000100:00100000:3.0:1788448464.744966:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 314 00000100:00100000:3.0:1788448464.744972:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801114496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448464.744998:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801114496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.745004:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 314 00000100:00080000:3.0:1788448464.745029:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448464.747562:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 315 00000100:00100000:3.0:1788448464.747819:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801113856 00000100:00100000:3.0:1788448464.748077:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801113856 00000100:00100000:3.0:1788448464.748120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 386 00000100:00100000:3.0:1788448464.748130:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801113856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448464.748253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801113856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 124us (3892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.748262:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 386 00000100:00080000:3.0:1788448464.748354:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448464.748461:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801114240 00000100:00100000:2.0:1788448464.748466:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801114240 00000100:00100000:2.0:1788448464.748511:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:2.0:1788448464.748519:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801114240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448464.748555:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083d50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801114240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (4029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.748562:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 144 00000100:00100000:0.0:1788448464.754616:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 316 00000100:00100000:0.0:1788448464.754649:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:2401:x1875323801113984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448464.754790:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:2401:x1875323801113984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 158us (10294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.754799:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 316 00000100:00100000:1.0:1788448464.760418:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801114368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788448464.761226:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448464.762093:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801114368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 14502us (17618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.762111:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 315 00010000:00010000:3.0:1788448464.894665:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448465.086110:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448465.086196:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826355328:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448465.086297:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448465.086416:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826355456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448465.086456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448465.086717:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355328 00000100:00100000:3.0:1788448465.086727:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355328 00000100:00100000:3.0:1788448465.086831:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355456 00000100:00100000:3.0:1788448465.086835:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355456 00000100:00100000:2.0:1788448465.087090:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788448465.087102:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826355328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448465.087139:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448465.087212:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826355328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448465.087220:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788448465.087240:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448465.087247:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826355456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448465.087256:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448465.087380:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826355456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 134us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448465.087387:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448465.087458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826355456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448465.087565:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826355328:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448465.598007:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826355584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448465.598073:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448465.598201:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355584 00000100:00100000:2.0:1788448465.598210:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355584 00000100:00100000:2.0:1788448465.598259:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788448465.598269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826355584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448465.598299:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788448465.598350:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826355584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448465.598357:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788448465.598642:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826355584:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788448465.925415:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448466.047420:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788448466.750320:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448466.750335:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448466.750359:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788448466.750374:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788448466.945046:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448467.647631:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448467.647661:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826355712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448467.647759:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448467.647843:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355712 00000100:00100000:3.0:1788448467.647852:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355712 00000100:00080000:0.0:1788448467.648170:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448467.648301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826355968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448467.648343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448467.650129:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788448467.650169:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826355712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448467.650213:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788448467.650305:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826355712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (2546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448467.650528:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448467.650551:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826355840:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448467.650600:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448467.650752:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826355712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448467.650804:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355968 00000100:00100000:2.0:1788448467.650812:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355968 00000100:00100000:0.0:1788448467.657687:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826355840 00000100:00100000:0.0:1788448467.657708:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826355840 00000100:00100000:0.0:1788448467.657778:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788448467.657790:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826355840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448467.657838:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448467.657981:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826355840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 193us (7380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448467.657989:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:0.0:1788448467.658019:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448467.658074:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826355840:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1788448467.667626:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788448467.667647:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:3.0:1788448467.669863:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788448467.670537:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788448467.670561:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826355968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448467.670601:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788448467.670717:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb8e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826355968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 166us (22372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448467.670724:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788448467.671087:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826355968:0@lo:13:osp-pre-0-1.0 00000001:00080000:0.0:1788448467.671837:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1788448467.671876:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc1ba2cbf00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788448467.671898:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc183f4fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1ba2cb300 00000020:00080000:0.0:1788448467.671901:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc183f4f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc08376b800 00000020:00080000:0.0:1788448467.671948:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788448467.671964:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788448467.672230:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:2.0:1788448467.672338:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.672364:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.672373:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.672380:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448467.672386:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.672394:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.672417:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9fc08336ac00) 00010000:00010000:2.0:1788448467.672420:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448467.672426:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.672433:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804054 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448467.967139:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448468.783531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448468.784665:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801114624 00000100:00100000:0.0:1788448468.784680:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801114624 00000100:00100000:0.0:1788448468.784764:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00100000:0.0:1788448468.784779:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:11080:x1875323801114624:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788448468.784908:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:11080:x1875323801114624:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 134us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448468.784917:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00080000:2.0:1788448468.784942:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448468.789420:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448468.789726:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801114752 00000100:00100000:3.0:1788448468.789739:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801114752 00000100:00100000:3.0:1788448468.789838:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 148 00000100:00100000:3.0:1788448468.789852:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:11080:x1875323801114752:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788448468.790030:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:11080:x1875323801114752:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 170us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448468.790055:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 148 00000100:00080000:2.0:1788448468.790211:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788448468.793244:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448468.793353:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115008 00000100:00100000:0.0:1788448468.793365:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115008 00000100:00100000:0.0:1788448468.793442:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1788448468.793454:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:11080:x1875323801115008:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448468.794010:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:11080:x1875323801115008:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 556us (776us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788448468.794020:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:1.0:1788448468.966795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448468.966996:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115136 00000100:00100000:0.0:1788448468.967005:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115136 00000100:00080000:2.0:1788448468.968160:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448468.968589:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:1.0:1788448468.968604:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:11887:x1875323801115136:12345-192.168.206.21@tcp:101:lsof.0 00010000:00010000:1.0:1788448468.968624:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448468.968643:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0797 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448468.968705:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448468.968720:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448468.968745:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448468.968792:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448468.968796:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448468.968983:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448468.969010:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b8040e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448468.969029:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 6 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448468.969052:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:1.0:1788448468.969055:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448468.969059:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030e00, rc 0) 00000100:00100000:1.0:1788448468.969124:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:11887:x1875323801115136:12345-192.168.206.21@tcp:101:lsof.0 Request processed in 524us (2337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448468.969131:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 149 00010000:00010000:3.0:1788448468.990842:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448469.694284:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826356352:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.694348:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448469.694399:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826356864:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.694424:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448469.694462:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826357376:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.694484:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448469.694508:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788448469.694514:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826356224:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.694535:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448469.694549:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826356736:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.694569:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448469.694582:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826357248:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.694601:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694673:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826356480:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694701:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694726:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826356992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694764:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826357504:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694783:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694799:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788448469.694805:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826356096:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694828:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694846:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc191315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826356608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694877:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826357120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694931:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826357632:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.694949:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.694975:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356992 00000100:00100000:1.0:1788448469.694982:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356992 00000100:00100000:1.0:1788448469.695030:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357504 00000100:00100000:1.0:1788448469.695033:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357504 00000100:00100000:1.0:1788448469.695044:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357120 00000100:00100000:1.0:1788448469.695046:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357120 00000100:00100000:1.0:1788448469.695057:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357632 00000100:00100000:1.0:1788448469.695059:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357632 00000100:00100000:1.0:1788448469.695072:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788448469.695080:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826356992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695125:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826356992:12345-0@lo:400:kworker.0 Request processed in 45us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695132:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788448469.695159:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788448469.695166:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695193:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826357504:12345-0@lo:400:kworker.0 Request processed in 28us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695199:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788448469.695213:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788448469.695219:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826357120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695227:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356864 00000100:00100000:3.0:1788448469.695243:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356864 00000100:00100000:1.0:1788448469.695246:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826357120:12345-0@lo:400:kworker.0 Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695254:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788448469.695268:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788448469.695274:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826357632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695276:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357376 00000100:00100000:3.0:1788448469.695282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357376 00000100:00100000:3.0:1788448469.695303:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356224 00000100:00100000:1.0:1788448469.695305:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826357632:12345-0@lo:400:kworker.0 Request processed in 30us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448469.695307:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356224 00000100:00100000:1.0:1788448469.695316:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788448469.695322:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356736 00000100:00100000:3.0:1788448469.695326:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356736 00000100:00080000:1.0:1788448469.695335:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448469.695341:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357248 00000100:00100000:3.0:1788448469.695345:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357248 00000100:00080000:1.0:1788448469.695347:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448469.695352:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448469.695354:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448469.695357:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448469.695375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356480 00000100:00100000:3.0:1788448469.695380:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356480 00000100:00100000:1.0:1788448469.695383:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788448469.695390:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083e21f80, transno 4294967311 00000100:00100000:3.0:1788448469.695398:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000004:00080000:1.0:1788448469.695400:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1788448469.695408:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826356864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826357120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695437:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826357632:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695448:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826356992:0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695459:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826356864:12345-0@lo:400:kworker.0 Request processed in 53us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695463:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083418700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826357504:0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695473:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788448469.695492:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788448469.695499:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826357376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695515:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:1.0:1788448469.695525:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695532:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826357376:12345-0@lo:400:kworker.0 Request processed in 31us (1044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448469.695538:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788448469.695553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788448469.695560:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826356736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695567:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826356224:12345-0@lo:400:kworker.0 Request processed in 44us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695575:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788448469.695596:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826356736:12345-0@lo:400:kworker.0 Request processed in 36us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695598:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788448469.695606:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826357248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695619:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788448469.695638:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788448469.695645:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826357248:12345-0@lo:400:kworker.0 Request processed in 40us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448469.695647:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826356480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695658:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788448469.695699:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826356480:12345-0@lo:400:kworker.0 Request processed in 55us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.695703:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826356224:0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1788448469.695721:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.695734:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826357248:0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.695745:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826356480:0@lo:400:kworker.0 00010000:00080000:1.0:1788448469.695762:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc191314a80 x1875323826356864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448469.695772:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191314a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826356864:0@lo:400:kworker.0 00010000:00080000:1.0:1788448469.695783:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4894a80 x1875323826357376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448469.695790:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826357376:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.696005:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356352 00000100:00100000:0.0:1788448469.696011:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356352 00000100:00100000:0.0:1788448469.696032:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356608 00000100:00100000:0.0:1788448469.696035:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356608 00000100:00100000:0.0:1788448469.696046:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788448469.696053:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826356352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.696091:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826356352:12345-0@lo:400:kworker.0 Request processed in 38us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.696103:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788448469.696118:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788448469.696123:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826356608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.696180:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826356608:12345-0@lo:400:kworker.0 Request processed in 56us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.696186:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788448469.696211:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826356096 00000100:00100000:0.0:1788448469.696215:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826356096 00000100:00100000:0.0:1788448469.696236:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788448469.696242:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826356096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.696269:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826356096:12345-0@lo:400:kworker.0 Request processed in 27us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.696275:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788448469.696420:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826356096:0@lo:400:kworker.0 00000100:00100000:3.0:1788448469.696435:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc191315500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826356608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.696544:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826356352:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.879702:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879755:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879788:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879825:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879848:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879916:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448469.879943:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115776 00000100:00100000:2.0:1788448469.879951:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115776 00000100:00100000:2.0:1788448469.879999:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115648 00000100:00100000:2.0:1788448469.880002:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115648 00000100:00100000:2.0:1788448469.880025:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:2.0:1788448469.880034:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801115776:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448469.880092:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801115776:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448469.880106:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:2.0:1788448469.880123:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:2.0:1788448469.880129:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801115648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448469.880179:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801115648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 51us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448469.880186:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00080000:1.0:1788448469.880265:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448469.880270:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448469.880402:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115392 00000100:00100000:1.0:1788448469.880407:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115392 00000100:00100000:1.0:1788448469.880443:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115520 00000100:00100000:1.0:1788448469.880446:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115520 00000100:00100000:1.0:1788448469.880465:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116032 00000100:00100000:1.0:1788448469.880468:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116032 00000100:00100000:1.0:1788448469.880485:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115904 00000100:00100000:1.0:1788448469.880487:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115904 00000100:00100000:1.0:1788448469.880500:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 323 00000100:00100000:1.0:1788448469.880506:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2399:x1875323801115392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448469.880542:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2399:x1875323801115392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.880548:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 323 00000100:00100000:1.0:1788448469.880561:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 324 00000100:00100000:1.0:1788448469.880567:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801115520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448469.880591:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801115520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.880604:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 324 00000100:00100000:1.0:1788448469.880617:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 325 00000100:00100000:1.0:1788448469.880622:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801116032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448469.880648:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801116032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.880654:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 325 00000100:00100000:1.0:1788448469.880664:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 326 00000100:00100000:1.0:1788448469.880670:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801115904:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448469.880689:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2399:x1875323801115904:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 19us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.880695:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 326 00000100:00080000:1.0:1788448469.880707:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448469.881430:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801115264 00000100:00100000:3.0:1788448469.881437:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801115264 00000100:00100000:3.0:1788448469.881525:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 388 00000100:00100000:3.0:1788448469.881534:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801115264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448469.881584:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801115264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 51us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448469.881591:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 388 00010000:00010000:3.0:1788448470.021542:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448470.206871:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826357760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448470.206969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448470.207096:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357760 00000100:00100000:1.0:1788448470.207104:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357760 00000100:00100000:1.0:1788448470.207165:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788448470.207175:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826357760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448470.207201:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448470.207253:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826357760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448470.207260:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788448470.207409:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826357888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448470.207436:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448470.207706:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826357888 00000100:00100000:3.0:1788448470.207711:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826357888 00000100:00100000:3.0:1788448470.207738:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788448470.207744:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826357888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448470.207755:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448470.207788:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826357888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448470.207810:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788448470.207921:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826357888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448470.208073:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826357760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448470.718285:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826358016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448470.718367:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448470.718608:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358016 00000100:00100000:1.0:1788448470.718628:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358016 00000100:00100000:1.0:1788448470.718683:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788448470.718693:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826358016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448470.718724:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788448470.718779:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826358016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448470.718786:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788448470.718958:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826358016:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788448471.038257:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448472.063208:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448472.184411:0:14512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:14:30 (1788448470) 00000100:00100000:3.0:1788448472.766261:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826358272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448472.766287:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826358144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448472.766336:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448472.766418:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358272 00000100:00100000:3.0:1788448472.766426:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358272 00000100:00100000:3.0:1788448472.766494:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788448472.766506:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826358272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448472.766533:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00080000:0.0:1788448472.766566:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448472.766600:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826358272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448472.766608:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788448472.766620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448472.766653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826358272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448472.766662:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448472.766672:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18325f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826358400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448472.766706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448472.766839:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358400 00000100:00100000:3.0:1788448472.766843:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358400 00000100:00100000:3.0:1788448472.766974:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788448472.766984:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826358400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448472.767008:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788448472.767120:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826358400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448472.767136:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788448472.767146:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358144 00000100:00100000:0.0:1788448472.767151:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358144 00000100:00100000:0.0:1788448472.767201:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788448472.767209:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826358144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448472.767221:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788448472.767251:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826358144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448472.767264:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:0.0:1788448472.767280:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448472.778695:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18325f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826358400:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448472.778719:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826358144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788448473.087767:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448473.817005:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788448473.817032:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788448473.817393:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788448473.817404:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788448473.878035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448473.878207:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116288 00000100:00100000:3.0:1788448473.878221:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116288 00000100:00100000:3.0:1788448473.878329:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:3.0:1788448473.878343:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:12154:x1875323801116288:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448473.878370:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448473.878396:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b8040ee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e079e expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878502:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878521:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878538:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878556:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878563:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878569:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878687:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804103 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878716:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878722:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804103 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448473.878732:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788448473.878834:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878841:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878848:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878854:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448473.878858:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878866:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878911:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc183b52700) 00010000:00010000:3.0:1788448473.878915:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448473.878920:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878926:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8040f5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878940:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878951:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878957:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878962:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448473.878965:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878970:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878978:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc1bb42bc00) 00010000:00010000:3.0:1788448473.878980:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448473.878983:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.878988:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8040fc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.879798:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b8040ee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e079e expref: 16 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.879825:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804103 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e079e expref: 15 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.879834:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:3.0:1788448473.879836:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448473.879847:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448473.879995:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:12154:x1875323801116288:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1655us (1973us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788448473.880004:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00080000:0.0:1788448473.880270:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448473.889309:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448473.889431:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448473.889709:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116416 00000100:00100000:0.0:1788448473.889722:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116416 00000100:00100000:0.0:1788448473.889799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 151 00000100:00100000:0.0:1788448473.889812:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:12154:x1875323801116416:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788448473.890000:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:12154:x1875323801116416:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 181us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448473.890010:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 151 00000100:00100000:3.0:1788448473.890435:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116544 00000100:00100000:3.0:1788448473.890442:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116544 00000100:00100000:3.0:1788448473.890492:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448473.890501:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:2401:x1875323801116544:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448473.890514:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448473.890543:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804103 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e079e expref: 15 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448473.890563:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:3.0:1788448473.890568:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448473.890592:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2401:x1875323801116544:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 93us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448473.890599:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:3.0:1788448473.896628:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448473.896742:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116672 00000100:00100000:0.0:1788448473.896756:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116672 00000100:00100000:0.0:1788448473.896864:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 152 00000100:00100000:0.0:1788448473.896879:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:12154:x1875323801116672:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788448473.897062:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:12154:x1875323801116672:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 186us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448473.897070:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 152 00000100:00080000:2.0:1788448473.897290:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:3.0:1788448473.918451:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448473.918462:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448473.918985:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788448473.919009:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788448474.110313:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448474.241500:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788448474.814532:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826358784:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.814642:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.814725:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826359296:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.814757:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.814783:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826359808:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.814806:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.814837:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788448474.814843:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826358912:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.814866:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.814905:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.814933:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.814971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826359936:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.814996:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.815030:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359296 00000100:00100000:1.0:1788448474.815039:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359296 00000100:00100000:1.0:1788448474.815104:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359808 00000100:00100000:1.0:1788448474.815107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359808 00000100:00100000:1.0:1788448474.815140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358912 00000100:00100000:1.0:1788448474.815143:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358912 00000100:00100000:1.0:1788448474.815165:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788448474.815175:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826359296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.815233:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826359296:12345-0@lo:400:kworker.0 Request processed in 59us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448474.815242:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788448474.815260:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788448474.815266:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826359808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.815292:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826359808:12345-0@lo:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448474.815299:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788448474.815310:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788448474.815317:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826358912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.815345:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826358912:12345-0@lo:400:kworker.0 Request processed in 29us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448474.815352:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788448474.815397:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826358912:0@lo:400:kworker.0 00010000:00080000:1.0:1788448474.815412:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083f61500 x1875323826359296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448474.815437:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826359296:0@lo:400:kworker.0 00010000:00080000:1.0:1788448474.815449:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9f80 x1875323826359808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448474.815457:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826359808:0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.815633:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358784 00000100:00100000:3.0:1788448474.815638:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358784 00000100:00100000:3.0:1788448474.815680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788448474.815690:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826358784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.815748:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826358784:12345-0@lo:400:kworker.0 Request processed in 60us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448474.815755:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788448474.815790:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826358784:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.815923:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826358656:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.815961:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.815985:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826359168:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816006:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.816030:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1c11ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826359680:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816052:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.816078:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788448474.816086:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826358528:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816126:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.816147:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826359040:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816170:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.816183:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826359552:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816203:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.816221:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826360064:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.816242:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359040 00000100:00100000:0.0:1788448474.816243:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448474.816247:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359040 00000100:00100000:1.0:1788448474.816268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788448474.816270:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358656 00000100:00100000:0.0:1788448474.816273:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358656 00000100:00100000:1.0:1788448474.816275:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826359040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.816314:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826359040:12345-0@lo:400:kworker.0 Request processed in 40us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448474.816320:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788448474.816342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826359040:0@lo:400:kworker.0 00000100:00100000:2.0:1788448474.816428:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359424 00000100:00100000:2.0:1788448474.816433:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359424 00000100:00100000:2.0:1788448474.816459:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359936 00000100:00100000:2.0:1788448474.816462:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359936 00000100:00100000:2.0:1788448474.816473:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359552 00000100:00100000:2.0:1788448474.816475:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359552 00000100:00100000:2.0:1788448474.816485:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826360064 00000100:00100000:2.0:1788448474.816487:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826360064 00000100:00100000:2.0:1788448474.816499:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788448474.816505:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826359424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448474.816552:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191315500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826359424:12345-0@lo:400:kworker.0 Request processed in 47us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448474.816557:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788448474.816570:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788448474.816570:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359168 00000100:00100000:0.0:1788448474.816573:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359168 00000100:00100000:2.0:1788448474.816575:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826359936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816588:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826359680 00000100:00100000:0.0:1788448474.816590:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826359680 00000100:00100000:2.0:1788448474.816601:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826359936:12345-0@lo:400:kworker.0 Request processed in 27us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.816604:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788448474.816610:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18325f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826358656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448474.816617:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788448474.816640:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448474.816645:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18325f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826358656:12345-0@lo:400:kworker.0 Request processed in 36us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448474.816646:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826359552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816651:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788448474.816664:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788448474.816669:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826359168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448474.816673:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826359552:12345-0@lo:400:kworker.0 Request processed in 28us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448474.816678:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788448474.816688:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788448474.816692:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826359168:12345-0@lo:400:kworker.0 Request processed in 23us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448474.816693:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826360064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816698:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788448474.816709:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788448474.816714:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826359680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448474.816716:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826360064:12345-0@lo:400:kworker.0 Request processed in 23us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448474.816721:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:2.0:1788448474.816740:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448474.816744:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083c69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875323826359680:12345-0@lo:400:kworker.0 Request processed in 30us (691us total) trans 0 rc 0/0 00000100:00080000:2.0:1788448474.816745:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448474.816748:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448474.816749:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00080000:2.0:1788448474.816750:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448474.816808:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826359552:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816819:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826360064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816827:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826358656:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816835:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826359168:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.816844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1c11ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875323826359680:0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.816985:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826358528 00000100:00100000:3.0:1788448474.816989:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826358528 00000100:00100000:3.0:1788448474.817020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1788448474.817027:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826358528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.817076:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826358528:12345-0@lo:400:kworker.0 Request processed in 50us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448474.817082:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1788448474.817203:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788448474.817214:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826359936:0@lo:400:kworker.0 00000100:00100000:2.0:1788448474.817301:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826358528:0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.981568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448474.981869:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448474.981949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116928 00000100:00100000:1.0:1788448474.981970:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116928 00000100:00100000:1.0:1788448474.982029:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 333 00000100:00100000:1.0:1788448474.982039:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2399:x1875323801116928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448474.982110:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2399:x1875323801116928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448474.982131:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 333 00000100:00100000:0.0:1788448474.983416:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801116800 00000100:00100000:0.0:1788448474.983426:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801116800 00000100:00100000:0.0:1788448474.983466:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 390 00000100:00100000:0.0:1788448474.983475:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801116800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448474.983521:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801116800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.983528:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 390 00000100:00100000:3.0:1788448474.990287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448474.990328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448474.990363:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448474.990397:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117056 00000100:00100000:3.0:1788448474.990404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448474.990409:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117056 00000100:00100000:0.0:1788448474.990462:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117568 00000100:00100000:0.0:1788448474.990466:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117568 00000100:00100000:0.0:1788448474.990500:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 334 00000100:00100000:0.0:1788448474.990510:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801117056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448474.990576:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801117056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448474.990592:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 335 00000100:00100000:0.0:1788448474.990605:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 334 00000100:00100000:3.0:1788448474.990607:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801117568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1788448474.990635:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448474.990643:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2399:x1875323801117568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448474.990651:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 335 00000100:00100000:1.0:1788448474.990737:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117184 00000100:00100000:1.0:1788448474.990747:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117184 00000100:00100000:1.0:1788448474.990793:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117312 00000100:00100000:1.0:1788448474.990796:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117312 00000100:00100000:1.0:1788448474.990819:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:1.0:1788448474.990826:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801117184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448474.990856:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf780380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801117184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448474.990864:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:3.0:1788448474.990875:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801117312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1788448474.990902:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448474.990907:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448474.990932:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2399:x1875323801117312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448474.994389:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:3.0:1788448474.994557:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:1.0:1788448474.995258:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448474.999419:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117440 00000100:00100000:0.0:1788448474.999435:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117440 00000100:00100000:0.0:1788448474.999521:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 336 00000100:00100000:0.0:1788448474.999532:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2398:x1875323801117440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448474.999611:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2398:x1875323801117440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 81us (4355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.999619:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 336 00000100:00080000:2.0:1788448475.000665:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448475.134065:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448475.328257:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448475.328278:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826360192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448475.328339:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448475.328408:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826360192 00000100:00100000:0.0:1788448475.328416:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826360192 00000100:00100000:0.0:1788448475.328469:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788448475.328479:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826360192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448475.328506:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448475.328552:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826360192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448475.328559:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788448475.328601:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ee3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826360192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448475.331031:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448475.331052:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826360320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448475.331126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448475.331178:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826360320 00000100:00100000:3.0:1788448475.331185:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826360320 00000100:00100000:3.0:1788448475.331243:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788448475.331253:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826360320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448475.331274:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448475.331321:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826360320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448475.331328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788448475.331369:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826360320:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448475.607166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448475.607368:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117696 00000100:00100000:2.0:1788448475.607377:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117696 00000100:00100000:2.0:1788448475.607445:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 153 00000100:00100000:2.0:1788448475.607456:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:12196:x1875323801117696:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448475.607475:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448475.607496:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07a5 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607554:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607591:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607603:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607617:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607624:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607631:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607677:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607683:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607707:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607713:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448475.607725:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607733:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607746:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:2.0:1788448475.607754:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448475.607759:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607766:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804118 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607778:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607795:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607801:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607807:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448475.607810:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607816:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607824:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc1bb543000) 00010000:00010000:2.0:1788448475.607827:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448475.607829:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607834:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b80411f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607869:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804111 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07a5 expref: 15 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607924:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:2.0:1788448475.607927:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448475.607931:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07a5 expref: 15 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.607940:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330400, rc 0) 00000100:00100000:2.0:1788448475.607996:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:12196:x1875323801117696:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 542us (838us total) trans 0 rc 301/301 00000100:00100000:2.0:1788448475.608003:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 153 00000100:00080000:3.0:1788448475.609187:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448475.618472:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448475.620561:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801117952 00000100:00100000:0.0:1788448475.620574:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801117952 00000100:00100000:0.0:1788448475.620674:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:0.0:1788448475.620707:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:12196:x1875323801117952:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:0.0:1788448475.620762:0:13810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448475.620788:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b803a65 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05c9 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.620806:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:0.0:1788448475.620811:0:13810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448475.620910:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.620925:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.620935:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.620966:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 5 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.620981:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 5 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448475.620995:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826360448:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448475.621081:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448475.622634:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ee3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826360448:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448475.622659:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448475.625375:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448475.628460:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118080 00000100:00100000:0.0:1788448475.628471:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118080 00010000:00010000:0.0:1788448475.628510:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 6 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448475.628543:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:0.0:1788448475.628554:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2398:x1875323801118080:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448475.628567:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448475.628574:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 6 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.628588:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 6 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.628610:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8040e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0797 expref: 6 pid: 6517 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.628625:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:0.0:1788448475.628631:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.628640:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.628647:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.628673:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448475.628737:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801118080:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 185us (3368us total) trans 0 rc 0/0 00010000:00010000:1.0:1788448475.631185:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.631201:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.631241:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.631258:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.631269:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.633256:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448475.633820:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00010000:00010000:1.0:1788448475.634755:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.634768:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448475.634938:0:13810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000550060be reply state 00000000aeb8cf2f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.634951:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.634959:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448475.634962:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448475.634967:0:13810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788448475.634972:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788448475.634980:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.634987:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.634994:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.635000:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448475.635005:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.635012:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.635042:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb42b800) 00010000:00010000:1.0:1788448475.635044:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448475.635048:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.635054:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804126 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448475.635078:0:13810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000550060be reply state 00000000aeb8cf2f transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.635087:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.635093:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc08319c600) 00010000:00010000:1.0:1788448475.635095:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448475.635097:0:13810:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788448475.635204:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:12196:x1875323801117952:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 14508us (16738us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788448475.635213:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 154 00000100:00100000:1.0:1788448475.767340:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448475.767434:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118208 00000100:00100000:0.0:1788448475.767443:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118208 00000100:00100000:0.0:1788448475.767494:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:0.0:1788448475.767503:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+15:12204:x1875323801118208:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:0.0:1788448475.767526:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448475.767552:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80413b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.767614:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804142 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.767627:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.767640:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448475.767686:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788448475.767689:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448475.767710:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804142 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.767733:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80413b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ac expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.767751:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804142 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ac expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.767778:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:0.0:1788448475.767781:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448475.767785:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f800, rc 0) 00000100:00100000:0.0:1788448475.767852:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:12204:x1875323801118208:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 349us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448475.767859:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 155 00000100:00100000:0.0:1788448475.838117:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448475.838142:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826360576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448475.838276:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448475.838525:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826360576 00000100:00100000:1.0:1788448475.838534:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826360576 00000100:00100000:1.0:1788448475.838704:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788448475.838715:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826360576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448475.838748:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788448475.838801:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ee3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826360576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448475.838835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788448475.838923:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826360576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448475.846055:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448475.846697:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118336 00000100:00100000:1.0:1788448475.846709:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118336 00000100:00100000:1.0:1788448475.846774:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:1.0:1788448475.846785:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1c11ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+16:12210:x1875323801118336:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448475.846804:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448475.846836:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b804149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07b3 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.846940:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.846955:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.846966:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.846977:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.846994:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847001:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847073:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80415e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847081:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80415e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847101:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80415e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448475.847147:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788448475.847151:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448475.847168:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80415e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847181:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847187:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847193:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847199:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448475.847203:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847210:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847221:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:1.0:1788448475.847224:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448475.847228:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847234:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847258:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847264:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847270:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847275:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448475.847278:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847284:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847292:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc08319c600) 00010000:00010000:1.0:1788448475.847294:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448475.847297:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847303:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b804157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847326:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030400/0xf45a9e4e6b804149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07b3 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847339:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80415e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07b3 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.847358:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448475.847361:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788448475.847363:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031a00, rc 0) 00000100:00100000:1.0:1788448475.847433:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1c11ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:12210:x1875323801118336:12345-192.168.206.21@tcp:101:bash.0 Request processed in 650us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448475.847441:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 156 00000100:00100000:2.0:1788448475.850348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448475.850679:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118592 00000100:00100000:3.0:1788448475.850693:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118592 00000100:00100000:3.0:1788448475.851908:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 157 00000100:00100000:3.0:1788448475.851931:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+17:12210:x1875323801118592:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448475.851958:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448475.851985:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804165 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07ba expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.852132:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.852150:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.852182:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.852517:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.852539:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.852551:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448475.853921:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788448475.854068:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854081:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854090:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854133:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854141:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854148:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854153:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448475.854169:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854178:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854190:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448475.854193:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448475.854197:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854204:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80416c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448475.854219:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008214c3e8 reply state 00000000e7c0064c transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854228:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854235:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:3.0:1788448475.854237:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448475.854240:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788448475.854283:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804165 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854298:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448475.854306:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:3.0:1788448475.854308:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448475.854315:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e800, rc 0) 00000100:00100000:3.0:1788448475.854392:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:12210:x1875323801118592:12345-192.168.206.21@tcp:101:bash.0 Request processed in 2470us (4058us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788448475.854400:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 157 00000100:00100000:3.0:1788448475.862058:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448475.862651:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118720 00000100:00100000:2.0:1788448475.862662:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118720 00000100:00100000:2.0:1788448475.862727:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:2.0:1788448475.862738:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801118720:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1788448475.862979:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448475.863061:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07c1 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448475.863089:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448475.863119:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:2.0:1788448475.863124:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448475.863133:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.863151:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 6 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448475.863354:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330200, rc 0) 00000100:00100000:2.0:1788448475.863405:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2400:x1875323801118720:12345-192.168.206.21@tcp:101:bash.0 Request processed in 668us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448475.863412:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:0.0:1788448475.871479:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448475.871734:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118848 00000100:00100000:1.0:1788448475.871744:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118848 00000100:00100000:1.0:1788448475.871798:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:1.0:1788448475.871808:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:12210:x1875323801118848:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448475.871983:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448475.872003:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07c8 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.872034:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.872044:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448475.872048:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448475.872054:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.872086:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.872132:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448475.872148:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1875323826360704:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448475.872292:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448475.876540:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f60e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1875323826360704:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448475.876576:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 7 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.876597:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030400, rc 0) 00000100:00100000:1.0:1788448475.876664:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:12210:x1875323801118848:12345-192.168.206.21@tcp:101:bash.0 Request processed in 4857us (5194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448475.876673:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:3.0:1788448475.879443:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448475.879657:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801118976 00000100:00100000:0.0:1788448475.879669:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801118976 00010000:00010000:0.0:1788448475.879719:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448475.879776:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:0.0:1788448475.879786:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801118976:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448475.879803:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448475.879828:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.879843:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.880054:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000031cecc77/0xf45a9e4e6b804188 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c1 expref: 7 pid: 8434 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.880075:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448475.880080:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448475.880089:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 6 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.880099:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 6 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448475.880151:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 6 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448475.880167:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc184e67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1875323826360832:192.168.206.21@tcp:105: 00000100:00100000:0.0:1788448475.880404:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448475.883789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448475.883878:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc184e67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6503:1875323826360832:192.168.206.21@tcp:105: 00010000:00010000:3.0:1788448475.883929:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448475.883977:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801119232 00000100:00100000:3.0:1788448475.884010:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2399:x1875323801118976:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 4223us (4580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448475.884023:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:1.0:1788448475.884043:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801119232 00000100:00100000:1.0:1788448475.884099:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:1.0:1788448475.884124:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:12210:x1875323801119232:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:1.0:1788448475.884715:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12210:x1875323801119232:12345-192.168.206.21@tcp:35:bash.0 Request processed in 603us (939us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788448475.884724:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:0.0:1788448475.978720:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448475.978929:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801119488 00000100:00100000:1.0:1788448475.978943:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801119488 00000100:00100000:1.0:1788448475.979031:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 158 00000100:00100000:1.0:1788448475.979044:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12220:x1875323801119488:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448475.979095:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448475.979134:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07cf expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448475.979285:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788448475.979408:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804196 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07cf expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.979426:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:1.0:1788448475.979430:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448475.979436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b804196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07cf expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448475.979454:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030e00, rc 0) 00000100:00100000:1.0:1788448475.979527:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:12220:x1875323801119488:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 486us (822us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788448475.979536:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 158 00000100:00100000:0.0:1788448475.984866:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448475.986943:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801119744 00000100:00100000:3.0:1788448475.986964:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801119744 00000100:00100000:3.0:1788448475.987057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1788448475.987071:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:12220:x1875323801119744:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448475.987403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:12220:x1875323801119744:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 333us (2550us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788448475.987412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:0.0:1788448476.079656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.079782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801119872 00000100:00100000:1.0:1788448476.079795:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801119872 00000100:00100000:1.0:1788448476.079930:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:1.0:1788448476.079944:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:12226:x1875323801119872:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448476.079976:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448476.080138:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8041a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07d6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.080234:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b8041ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.080272:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b8041ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.080285:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b8041ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448476.080352:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788448476.080357:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448476.080494:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b8041ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.080528:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8041a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07d6 expref: 25 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.080552:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b8041ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07d6 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.080562:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448476.080565:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448476.080569:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180031000, rc 0) 00000100:00100000:1.0:1788448476.080639:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:12226:x1875323801119872:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 698us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448476.080646:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 159 00000100:00100000:0.0:1788448476.094461:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.094796:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801120128 00000100:00100000:1.0:1788448476.095089:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801120128 00000100:00100000:1.0:1788448476.095222:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:1.0:1788448476.095234:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:12226:x1875323801120128:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448476.095259:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448476.095302:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8041b2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07dd expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.095456:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8041b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.095472:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8041b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.095486:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8041b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448476.095499:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788448476.095712:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8041b2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07dd expref: 27 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.095747:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8041b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07dd expref: 26 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.095757:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:1.0:1788448476.095760:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448476.095765:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc180030a00, rc 0) 00000100:00100000:1.0:1788448476.096162:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+26:12226:x1875323801120128:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 928us (1713us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788448476.096172:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:0.0:1788448476.101666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.101833:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801120384 00000100:00100000:1.0:1788448476.101857:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801120384 00000100:00100000:1.0:1788448476.101968:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 161 00000100:00100000:1.0:1788448476.101980:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+26:12226:x1875323801120384:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448476.102039:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448476.102064:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8041c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07e4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.102222:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b8041ce lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.102239:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b8041ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.102254:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b8041ce lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448476.102268:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788448476.102398:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030e00/0xf45a9e4e6b8041c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07e4 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.102419:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b8041ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07e4 expref: 28 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.102430:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:1.0:1788448476.102434:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788448476.102438:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fce00, rc 0) 00000100:00100000:1.0:1788448476.102507:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+28:12226:x1875323801120384:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 529us (855us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788448476.102515:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 161 00000100:00100000:0.0:1788448476.106397:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.106514:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801120512 00000100:00100000:2.0:1788448476.106527:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801120512 00000100:00100000:2.0:1788448476.106794:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1788448476.106807:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+28:2400:x1875323801120512:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448476.106827:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448476.106873:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180030a00/0xf45a9e4e6b8041b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07dd expref: 28 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.106952:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:2.0:1788448476.106959:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448476.107045:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:2400:x1875323801120512:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 239us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.107053:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448476.116250:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448476.116523:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801120640 00000100:00100000:3.0:1788448476.116536:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801120640 00000100:00100000:3.0:1788448476.116783:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:3.0:1788448476.116797:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801120640:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:3.0:1788448476.116865:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.117059:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 6 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.117086:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448476.117091:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448476.117096:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.117148:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 6 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.117163:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 6 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448476.117180:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875323826360960:192.168.206.21@tcp:104: 00000100:00080000:2.0:1788448476.117358:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448476.117407:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448476.122239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448476.122412:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8431:1875323826360960:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448476.122451:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448476.122521:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801120768 00000100:00100000:0.0:1788448476.122548:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801120768 00002000:00100000:0.0:1788448476.122676:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9fc083f60e00 x1875323801120768/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:712/0 lens 504/0 e 0 to 0 dl 1788448487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448476.122688:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083f60e00 with x1875323801120768 ext(0->12) 00010000:00010000:0.0:1788448476.122698:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 7 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.122715:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 7 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448476.122724:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc083f60e00 00000100:00100000:0.0:1788448476.122807:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:0.0:1788448476.122831:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801120768:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:0.0:1788448476.126167:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801120768:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 3320us (3927us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788448476.126185:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00002000:00100000:0.0:1788448476.126201:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9fc083f60e00 x1875323801120768/t4294967306(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:712/0 lens 504/448 e 0 to 0 dl 1788448487 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448476.126213:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083f60e00 with x1875323801120768 ext(0->12) 00010000:00010000:0.0:1788448476.126226:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 9 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.126250:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 9 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448476.126280:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc083f60e00 00000100:00100000:0.0:1788448476.143667:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.145185:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801120896 00000100:00100000:2.0:1788448476.145215:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801120896 00010000:00010000:2.0:1788448476.145283:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 9 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448476.145409:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:2.0:1788448476.145422:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801120896:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448476.145469:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788448476.145493:0:13187:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788448476.145496:0:13187:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788448475 00002000:00010000:2.0:1788448476.145499:0:13187:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788448475 00002000:00010000:2.0:1788448476.145502:0:13187:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788448475 00002000:00010000:2.0:1788448476.145504:0:13187:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788448476.145512:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 9 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.145530:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 9 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.145561:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047fa792a/0xf45a9e4e6b80418f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07c8 expref: 9 pid: 8539 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.145592:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448476.145597:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448476.145604:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.145616:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.145662:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448476.145744:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801120896:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 324us (2091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.145754:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00010000:00010000:1.0:1788448476.145840:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145873:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145918:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145928:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145936:0:8431:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145944:0:8431:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448476.145949:0:8431:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145959:0:8431:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145973:0:8431:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.145991:0:8431:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b8041dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448476.146059:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801120640:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 29264us (29824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448476.146069:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:3.0:1788448476.153292:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.153466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801121152 00000100:00100000:1.0:1788448476.153481:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801121152 00000100:00100000:1.0:1788448476.153556:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:1.0:1788448476.153568:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12226:x1875323801121152:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:1.0:1788448476.153672:0:6520:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b8041ce lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07e4 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448476.153977:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788448476.154252:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788448476.154808:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788448476.157139:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.157177:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.157187:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.157246:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.157269:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 31 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448476.157314:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875323826361088:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448476.157459:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448476.160550:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6520:1875323826361088:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448476.160720:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448476.160876:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.162006:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801121280 00000100:00100000:2.0:1788448476.162021:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801121280 00010000:00010000:2.0:1788448476.162077:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 32 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448476.162129:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:2.0:1788448476.162140:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:2398:x1875323801121280:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448476.162159:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448476.162168:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 32 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.162183:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 32 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.162220:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b80417a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ba expref: 32 pid: 6518 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.162243:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:2.0:1788448476.162249:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.162260:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.162269:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.162304:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448476.162392:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+31:2398:x1875323801121280:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 253us (1517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.162418:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00010000:00010000:1.0:1788448476.162660:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.162669:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448476.162815:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788448476.163005:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788448476.163127:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826361216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788448476.163202:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448476.163246:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977180 going to sleep for 11 seconds 00010000:00010000:1.0:1788448476.163290:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448476.163721:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826361216 00000100:00100000:2.0:1788448476.163730:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826361216 00000100:00100000:2.0:1788448476.163787:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788448476.163798:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875323826361216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788448476.163952:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875323826361216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 156us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.163961:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788448476.164024:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826361216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788448476.164184:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:2.0:1788448476.164250:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826361344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788448476.164285:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448476.164303:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448476.164316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826361344 00000100:00100000:2.0:1788448476.164319:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826361344 00000100:00100000:2.0:1788448476.164340:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788448476.164346:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6520:x1875323826361344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788448476.164447:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6520:x1875323826361344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (162us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788448476.164454:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788448476.164484:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e0e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6520:1875323826361344:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788448476.164520:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788448476.164554:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.164566:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.165121:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.165128:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448476.165133:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.165143:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.165163:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:2.0:1788448476.165166:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788448476.165173:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.165180:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd200/0xf45a9e4e6b8041e3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448476.165313:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788448476.165388:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:2.0:1788448476.165402:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393510519231ns, next at 394510516744ns, rc = 0 00000001:00080000:2.0:1788448476.165409:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788448476.165443:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42b900) 00010000:00010000:2.0:1788448476.165446:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788448476.165455:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b8041ce lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07e4 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448476.165566:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:12226:x1875323801121152:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 12000us (12291us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788448476.165596:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000020:00080000:2.0:1788448476.165601:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788448476.165763:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448476.171562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.171723:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801121408 00000100:00100000:2.0:1788448476.171737:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801121408 00000100:00100000:2.0:1788448476.171823:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 162 00000100:00100000:2.0:1788448476.171837:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:12226:x1875323801121408:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448476.171916:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448476.171949:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8041ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07eb expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.172037:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8041ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07eb expref: 35 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.172055:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8041ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07eb expref: 35 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.172077:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448476.172080:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448476.172085:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331000, rc 0) 00000100:00100000:2.0:1788448476.172166:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:12226:x1875323801121408:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 331us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.172175:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 162 00000100:00100000:0.0:1788448476.179518:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.179741:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801121664 00000100:00100000:1.0:1788448476.179755:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801121664 00000100:00100000:1.0:1788448476.180328:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:1.0:1788448476.180345:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:12226:x1875323801121664:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1788448476.180812:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+36:12226:x1875323801121664:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 461us (1301us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788448476.180822:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000040:00080000:0.0:1788448476.286917:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448476.295550:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448476.295688:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801121920 00000100:00100000:0.0:1788448476.295703:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801121920 00000100:00100000:0.0:1788448476.295870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:0.0:1788448476.295933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+36:12236:x1875323801121920:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448476.295967:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448476.295994:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8041f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448476.296166:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788448476.296299:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8041f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f2 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.296317:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:0.0:1788448476.296321:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448476.296326:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8041f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f2 expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.296343:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f600, rc 0) 00000100:00100000:0.0:1788448476.296439:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12236:x1875323801121920:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 557us (902us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788448476.296469:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 163 00000100:00100000:0.0:1788448476.300740:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.300867:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801122048 00000100:00100000:1.0:1788448476.300923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801122048 00000100:00100000:1.0:1788448476.301007:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:1.0:1788448476.301019:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12236:x1875323801122048:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:1.0:1788448476.301146:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301168:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301181:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301193:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301202:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301209:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301557:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301569:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301577:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448476.301641:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301671:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301678:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301686:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301691:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448476.301697:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301705:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301721:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448476.301724:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448476.301729:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301735:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b8041ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301750:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301755:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301760:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301770:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fde00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448476.301774:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301779:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301786:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:1.0:1788448476.301789:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448476.301791:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301796:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804206 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301804:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301810:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301814:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301818:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448476.301821:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301826:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301840:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448476.301842:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448476.301845:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.301851:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b80420d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448476.302162:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12236:x1875323801122048:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 958us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448476.302175:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 164 00000100:00100000:3.0:1788448476.304683:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.304935:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801122304 00000100:00100000:2.0:1788448476.304948:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801122304 00000100:00100000:2.0:1788448476.305025:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:2.0:1788448476.305038:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12236:x1875323801122304:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448476.305651:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:12236:x1875323801122304:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 611us (977us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788448476.305663:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:0.0:1788448476.349967:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.350207:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801122560 00000100:00100000:2.0:1788448476.350221:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801122560 00000100:00100000:2.0:1788448476.350308:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:2.0:1788448476.350321:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:12239:x1875323801122560:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448476.350359:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448476.350388:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804214 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e07f9 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350496:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350514:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350527:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350540:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350547:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350554:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350699:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350727:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350734:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448476.350745:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788448476.350862:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350871:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350878:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350926:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448476.350930:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350938:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350952:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:2.0:1788448476.350955:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448476.350961:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350967:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80421b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350982:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.350994:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.351001:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.351006:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448476.351009:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.351015:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.351022:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:2.0:1788448476.351025:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448476.351028:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.351035:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804222 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.352285:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804214 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 41 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.352324:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 40 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.352334:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448476.352336:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448476.352354:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331400, rc 0) 00000100:00100000:3.0:1788448476.353601:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:12239:x1875323801122560:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 3267us (3636us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788448476.353615:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:1.0:1788448476.356800:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.357402:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801122688 00000100:00100000:2.0:1788448476.357415:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801122688 00000100:00100000:2.0:1788448476.357525:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:2.0:1788448476.357536:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:12239:x1875323801122688:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1788448476.357617:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357637:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357651:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357693:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357700:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357708:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357713:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448476.357718:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357726:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357737:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448476.357740:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448476.357761:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.357768:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330800/0xf45a9e4e6b804237 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448476.357877:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:12239:x1875323801122688:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 337us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.357916:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:1.0:1788448476.362304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.362390:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801122944 00000100:00100000:2.0:1788448476.362403:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801122944 00000100:00100000:2.0:1788448476.362474:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:2.0:1788448476.362488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:12239:x1875323801122944:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448476.362823:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+41:12239:x1875323801122944:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 336us (533us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1788448476.362832:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:1.0:1788448476.653204:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448476.653314:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801123200 00000100:00100000:0.0:1788448476.653325:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801123200 00000100:00100000:0.0:1788448476.653386:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:0.0:1788448476.653400:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+41:12270:x1875323801123200:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:0.0:1788448476.653427:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448476.653448:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80423e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0800 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.653566:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804245 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.653580:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.653592:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804245 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448476.653605:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788448476.653709:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80423e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0800 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.653728:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804245 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0800 expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.653738:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448476.653753:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448476.653758:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448476.653960:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12270:x1875323801123200:12345-192.168.206.21@tcp:101:cat.0 Request processed in 562us (763us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788448476.653968:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:0.0:1788448476.668156:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448476.668271:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.669143:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801123584 00000100:00100000:2.0:1788448476.669154:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801123584 00000100:00100000:2.0:1788448476.669211:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:2.0:1788448476.669221:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12270:x1875323801123584:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:2.0:1788448476.669488:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:12270:x1875323801123584:12345-192.168.206.21@tcp:35:cat.0 Request processed in 267us (1216us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788448476.669496:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:3.0:1788448476.671877:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801123328 00000100:00100000:3.0:1788448476.671918:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801123328 00000100:00100000:3.0:1788448476.671979:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1788448476.671990:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:2399:x1875323801123328:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448476.672004:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448476.672042:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804245 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0800 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.672062:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448476.672068:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448476.672138:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:2399:x1875323801123328:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 150us (3994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448476.672294:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1788448476.775543:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448476.775674:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801123840 00000100:00100000:1.0:1788448476.775686:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801123840 00000100:00100000:1.0:1788448476.775751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:1.0:1788448476.775763:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12276:x1875323801123840:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788448476.775788:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448476.775791:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788448476.775816:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031000/0xf45a9e4e6b8041ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07d6 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.775835:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448476.775840:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448476.775852:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804253 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0807 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.776013:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.776416:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 43 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.776427:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.776460:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 43 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.776474:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 43 pid: 9023 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448476.776488:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826361472:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448476.776649:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448476.779948:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6517:1875323826361472:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448476.779978:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448476.782814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448476.786311:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801123968 00000100:00100000:2.0:1788448476.786326:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801123968 00010000:00010000:2.0:1788448476.786384:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 44 pid: 9023 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448476.786590:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:2.0:1788448476.786601:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:2399:x1875323801123968:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448476.786616:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448476.786624:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 44 pid: 9023 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.786637:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 44 pid: 9023 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.786658:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804229 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07f9 expref: 44 pid: 9023 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.786673:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448476.786678:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.786687:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.786695:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448476.786732:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448476.786790:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:2399:x1875323801123968:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 191us (3984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.786797:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00010000:00010000:1.0:1788448476.788250:0:6517:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.788264:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448476.788282:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788448476.788431:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804253 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.788452:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 43 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448476.788474:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448476.788477:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448476.788480:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc800, rc 0) 00000100:00100000:1.0:1788448476.788533:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12276:x1875323801123840:12345-192.168.206.21@tcp:101:dd.0 Request processed in 12772us (13000us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788448476.788541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 168 00000100:00100000:0.0:1788448476.795877:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448476.796410:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801124096 00000100:00100000:3.0:1788448476.796426:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801124096 00000100:00100000:3.0:1788448476.796557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:3.0:1788448476.796570:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12276:x1875323801124096:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788448476.796601:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448476.796626:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804268 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e080e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.796667:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.796683:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.796695:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.796857:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804268 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 45 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.796932:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 44 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.796942:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448476.796946:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448476.796949:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f200, rc 0) 00000100:00100000:3.0:1788448476.797045:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:12276:x1875323801124096:12345-192.168.206.21@tcp:101:dd.0 Request processed in 470us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448476.797054:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 169 00000100:00100000:3.0:1788448476.799562:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448476.800092:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801124352 00000100:00100000:0.0:1788448476.800112:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801124352 00000100:00100000:0.0:1788448476.800186:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 170 00000100:00100000:0.0:1788448476.800199:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:12276:x1875323801124352:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:0.0:1788448476.800486:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.800507:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.800519:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448476.800564:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788448476.800589:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002406f1a7 reply state 000000001fedf7d7 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.800619:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.800627:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448476.800630:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788448476.800633:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448476.800739:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:12276:x1875323801124352:12345-192.168.206.21@tcp:36:dd.0 Request processed in 541us (1190us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788448476.800747:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 170 00000020:00080000:0.0:1788448476.800754:0:13811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788448477.000871:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448477.000899:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448477.009205:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788448477.009219:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448477.100982:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.101361:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801124480 00000100:00100000:3.0:1788448477.101371:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801124480 00000100:00100000:3.0:1788448477.101445:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:3.0:1788448477.101455:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:12290:x1875323801124480:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:3.0:1788448477.101478:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788448477.101479:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448477.101497:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b80427d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0815 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101590:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101605:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101634:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101646:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101653:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101659:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101745:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101756:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101764:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101805:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 48 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.101819:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 48 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.101833:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826361600:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448477.102345:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448477.107329:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb576300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826361600:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448477.107362:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.107536:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448477.109083:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801124736 00000100:00100000:2.0:1788448477.109133:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801124736 00000100:00100000:2.0:1788448477.109281:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:2.0:1788448477.109295:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+49:6168:x1875323801124736:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788448477.109694:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:6168:x1875323801124736:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 401us (2157us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788448477.109703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:1.0:1788448477.112680:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.113228:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801124864 00000100:00100000:3.0:1788448477.113241:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801124864 00010000:00010000:3.0:1788448477.113359:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 50 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.113435:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:3.0:1788448477.113448:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:2399:x1875323801124864:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448477.113465:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448477.113473:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 50 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.113489:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 50 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.113517:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc800/0xf45a9e4e6b80425a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0807 expref: 50 pid: 6517 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.113537:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448477.113542:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.113552:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.113560:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.113616:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448477.113705:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.113714:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448477.113781:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788448477.113787:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448477.113817:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.113833:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.113843:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.113851:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.113866:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.113901:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.113906:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.113927:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+49:2399:x1875323801124864:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 481us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.113936:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00010000:00010000:0.0:1788448477.113989:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114003:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448477.114006:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.114011:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114018:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804284 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114036:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114043:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114049:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114054:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.114057:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114073:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114082:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:0.0:1788448477.114085:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.114088:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114093:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80428b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114138:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b80427d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0815 expref: 49 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114153:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0815 expref: 48 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.114160:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.114163:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448477.114165:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:0.0:1788448477.114194:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+48:12290:x1875323801124480:12345-192.168.206.21@tcp:101:stat.0 Request processed in 12742us (13225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.114200:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 171 00010000:00010000:3.0:1788448477.182316:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448477.184728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448477.185067:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801125120 00000100:00100000:2.0:1788448477.185080:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801125120 00000100:00100000:2.0:1788448477.185165:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 172 00000100:00100000:2.0:1788448477.185183:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+48:12296:x1875323801125120:12345-192.168.206.21@tcp:36:truncate.0 00010000:00010000:2.0:1788448477.185264:0:13810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448477.185296:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804292 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0815 expref: 48 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.185321:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448477.185328:0:13810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448477.185605:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.185621:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.185639:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448477.185709:0:13810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788448477.185734:0:13810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000e338cc8 reply state 00000000279d3c91 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.185771:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.185778:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448477.185781:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448477.185789:0:13810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448477.186158:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:12296:x1875323801125120:12345-192.168.206.21@tcp:36:truncate.0 Request processed in 979us (1440us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788448477.186172:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 172 00000020:00080000:2.0:1788448477.186182:0:13810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788448477.362459:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.362692:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801125248 00000100:00100000:0.0:1788448477.362706:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801125248 00000100:00100000:0.0:1788448477.362785:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:0.0:1788448477.362796:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+50:12310:x1875323801125248:12345-192.168.206.21@tcp:101:stat.0 00010000:00010000:0.0:1788448477.362842:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448477.362867:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8042a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e081c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.362975:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.362992:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363148:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363162:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363169:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363176:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363329:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363340:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363347:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448477.363397:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788448477.363409:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448477.363436:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363451:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363460:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.363467:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364134:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364141:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.364146:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364155:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364171:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448477.364175:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.364181:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364189:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8042a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364205:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364226:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364233:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364238:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.364242:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364547:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364557:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:0.0:1788448477.364560:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.364563:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364569:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8042ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364611:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8042a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 52 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364625:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 51 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.364632:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.364634:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448477.364644:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:0.0:1788448477.364793:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:12310:x1875323801125248:12345-192.168.206.21@tcp:101:stat.0 Request processed in 1996us (2346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.364803:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 173 00000100:00100000:0.0:1788448477.472668:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.472782:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801125504 00000100:00100000:1.0:1788448477.472800:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801125504 00000100:00100000:1.0:1788448477.473034:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:1.0:1788448477.473048:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:12320:x1875323801125504:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448477.473074:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448477.473339:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8042bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0823 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448477.473475:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788448477.473609:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8042bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0823 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.473626:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:1.0:1788448477.473629:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448477.473652:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8042bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0823 expref: 53 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.473670:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd600, rc 0) 00000100:00100000:1.0:1788448477.473759:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:12320:x1875323801125504:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 715us (1112us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788448477.473768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 174 00000100:00100000:3.0:1788448477.483823:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.483984:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801125760 00000100:00100000:1.0:1788448477.484006:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801125760 00000100:00100000:1.0:1788448477.484071:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:1.0:1788448477.484083:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b99050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:12320:x1875323801125760:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1788448477.484379:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b99050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:12320:x1875323801125760:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 296us (568us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788448477.484388:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1788448477.547156:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.547378:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801126016 00000100:00100000:1.0:1788448477.547392:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801126016 00000100:00100000:1.0:1788448477.547479:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:1.0:1788448477.547492:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+53:12326:x1875323801126016:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448477.547528:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448477.547555:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8042ca lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e082a expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.547736:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.547755:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.547778:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.547823:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.547839:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 54 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448477.547854:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826361728:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448477.548003:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448477.550570:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.550717:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826361728:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448477.550753:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448477.550933:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801126144 00000100:00100000:2.0:1788448477.550943:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801126144 00010000:00010000:2.0:1788448477.551117:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 55 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.551239:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:0.0:1788448477.551253:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+55:2398:x1875323801126144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448477.551272:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448477.551301:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 55 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.551315:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 55 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.551342:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8042b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e081c expref: 55 pid: 6519 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.551360:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.551365:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.551379:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.551387:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.551418:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448477.551501:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:2398:x1875323801126144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 251us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.551509:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 87 00010000:00010000:1.0:1788448477.552186:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.552198:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448477.552222:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788448477.552408:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8042ca lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 55 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.552428:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 54 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.552453:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448477.552456:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448477.552459:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd800, rc 0) 00000100:00100000:1.0:1788448477.552517:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:12326:x1875323801126016:12345-192.168.206.21@tcp:101:bash.0 Request processed in 5027us (5380us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788448477.552525:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 175 00000100:00100000:0.0:1788448477.557239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.558222:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801126400 00000100:00100000:3.0:1788448477.558238:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801126400 00000100:00100000:3.0:1788448477.558465:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 176 00000100:00100000:3.0:1788448477.558479:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:12326:x1875323801126400:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:3.0:1788448477.558784:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.558876:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.559063:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448477.559129:0:13811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1788448477.559154:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f88aea3d reply state 00000000b8087ada transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.559168:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.559176:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448477.559180:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448477.559201:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448477.559627:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+57:12326:x1875323801126400:12345-192.168.206.21@tcp:36:bash.0 Request processed in 1146us (2400us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1788448477.559637:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 176 00000020:00080000:3.0:1788448477.559642:0:13811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788448477.565781:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.566506:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801126528 00000100:00100000:3.0:1788448477.566519:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801126528 00000100:00100000:3.0:1788448477.566632:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:3.0:1788448477.566644:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+57:12326:x1875323801126528:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448477.566676:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448477.566700:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b8042e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0831 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.566822:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.566838:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 58 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.566847:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.566922:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 58 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.566937:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 58 pid: 13810 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.566952:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826361856:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448477.567180:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448477.571003:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.571520:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801126656 00000100:00100000:0.0:1788448477.571533:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801126656 00010000:00010000:0.0:1788448477.571584:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 59 pid: 13810 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.571632:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:0.0:1788448477.571642:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:2399:x1875323801126656:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448477.571659:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448477.571667:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 59 pid: 13810 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.571683:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 59 pid: 13810 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.571711:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.571717:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.571729:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.571737:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.571784:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448477.572120:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:2399:x1875323801126656:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 477us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.572128:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00010000:00010000:3.0:1788448477.572506:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b8042d1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e082a expref: 58 pid: 13810 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.572528:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826361856:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448477.572551:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.572599:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.572606:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448477.572669:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788448477.572674:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448477.572695:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.572729:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b8042e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0831 expref: 58 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.572744:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0831 expref: 57 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.572753:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448477.572755:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448477.572758:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ee00, rc 0) 00000100:00100000:3.0:1788448477.572789:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+57:12326:x1875323801126528:12345-192.168.206.21@tcp:101:bash.0 Request processed in 6148us (7026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.572869:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:0.0:1788448477.575719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.575965:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801126912 00000100:00100000:1.0:1788448477.576048:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801126912 00000100:00100000:1.0:1788448477.576130:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:1.0:1788448477.576143:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+57:12326:x1875323801126912:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:1.0:1788448477.576581:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:12326:x1875323801126912:12345-192.168.206.21@tcp:35:bash.0 Request processed in 438us (872us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788448477.576589:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:1.0:1788448477.654370:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.654469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801127168 00000100:00100000:3.0:1788448477.654482:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801127168 00000100:00100000:3.0:1788448477.654553:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 178 00000100:00100000:3.0:1788448477.654564:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:12336:x1875323801127168:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448477.654593:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448477.654618:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b8042f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0838 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448477.654747:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788448477.655033:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b8042f4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0838 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.655052:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:3.0:1788448477.655055:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448477.655061:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b8042f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0838 expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.655077:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448477.655156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12336:x1875323801127168:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 593us (801us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788448477.655165:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 178 00000100:00100000:2.0:1788448477.666601:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.666766:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801127296 00000100:00100000:0.0:1788448477.666791:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801127296 00000100:00100000:0.0:1788448477.667017:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 179 00000100:00100000:0.0:1788448477.667031:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12336:x1875323801127296:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:0.0:1788448477.667146:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667167:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667184:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667197:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667205:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667211:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667304:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667337:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667345:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448477.667418:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667433:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667440:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667447:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667453:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.667457:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667465:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667478:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448477.667481:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.667486:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667492:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804302 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667513:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667519:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667524:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667529:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.667532:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667537:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667545:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:0.0:1788448477.667547:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.667549:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667554:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804309 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667571:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667578:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667583:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667594:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.667597:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667602:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667609:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.667612:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.667615:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.667620:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804310 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.667720:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12336:x1875323801127296:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 691us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.667729:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 179 00000100:00100000:0.0:1788448477.673075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448477.673617:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801127552 00000100:00100000:2.0:1788448477.673632:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801127552 00000100:00100000:2.0:1788448477.673709:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:2.0:1788448477.673722:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12336:x1875323801127552:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448477.674043:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:12336:x1875323801127552:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 321us (981us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788448477.674052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1788448477.749431:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.749591:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801127808 00000100:00100000:0.0:1788448477.749603:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801127808 00000100:00100000:0.0:1788448477.749677:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 180 00000100:00100000:0.0:1788448477.749690:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:12339:x1875323801127808:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448477.749719:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448477.749745:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804317 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e083f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.749857:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.749925:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.749941:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.749956:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.749964:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.749971:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750143:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80432c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750153:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80432c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750161:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80432c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448477.750172:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788448477.750295:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750305:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750312:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750326:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.750331:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750340:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750356:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448477.750359:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.750364:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750372:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80431e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750389:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750395:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750401:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750406:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448477.750410:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750417:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750435:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:0.0:1788448477.750437:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448477.750440:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750446:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750491:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804317 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e083f expref: 63 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750507:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80432c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e083f expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.750515:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.750517:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448477.750519:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:0.0:1788448477.750591:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:12339:x1875323801127808:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 903us (1173us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788448477.750599:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 180 00000100:00100000:3.0:1788448477.755968:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.756150:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801127936 00000100:00100000:1.0:1788448477.756162:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801127936 00000100:00100000:1.0:1788448477.756236:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 181 00000100:00100000:1.0:1788448477.756259:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:12339:x1875323801127936:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1788448477.756361:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756384:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756399:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756466:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756475:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756482:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756489:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448477.756495:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756504:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756517:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448477.756521:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448477.756526:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.756532:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b80433a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448477.756624:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:12339:x1875323801127936:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 376us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448477.756632:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 181 00000100:00100000:1.0:1788448477.759239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.759471:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801128064 00000100:00100000:0.0:1788448477.759483:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801128064 00000100:00100000:0.0:1788448477.759561:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1788448477.759574:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:2400:x1875323801128064:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448477.759592:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448477.759621:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80432c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e083f expref: 62 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.759669:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.759674:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448477.759750:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:2400:x1875323801128064:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 177us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.759758:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:0.0:1788448477.762720:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448477.762827:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801128320 00000100:00100000:2.0:1788448477.762839:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801128320 00000100:00100000:2.0:1788448477.763193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1788448477.763210:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+61:12339:x1875323801128320:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:2.0:1788448477.763525:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:12339:x1875323801128320:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 318us (817us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788448477.765579:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:3.0:1788448477.887131:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448477.887162:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc081a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826361984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448477.887258:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448477.887682:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826361984 00000100:00100000:2.0:1788448477.887693:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826361984 00000100:00100000:2.0:1788448477.887771:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448477.887782:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826361984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448477.887828:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788448477.887903:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826361984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448477.887912:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448477.888142:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc081a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826361984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448477.888200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826362112:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448477.888239:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448477.888390:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448477.888401:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826362240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448477.888442:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448477.888657:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826362240 00000100:00100000:0.0:1788448477.888663:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826362240 00000100:00100000:0.0:1788448477.888775:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788448477.888786:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826362240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448477.888804:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788448477.888857:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826362240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.888865:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788448477.888925:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826362112 00000100:00100000:0.0:1788448477.888930:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826362112 00000100:00100000:1.0:1788448477.888937:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826362240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448477.888962:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788448477.888971:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826362112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448477.889001:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448477.889049:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826362112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.889056:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788448477.889166:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826362112:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1788448477.889675:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448477.940445:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.940577:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801128576 00000100:00100000:3.0:1788448477.940591:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801128576 00000100:00100000:3.0:1788448477.940732:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:3.0:1788448477.940746:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+62:12357:x1875323801128576:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:3.0:1788448477.940781:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448477.940812:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804341 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0846 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.941028:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804348 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.941047:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.941060:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804348 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448477.941074:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788448477.941223:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804341 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0846 expref: 65 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.941246:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804348 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0846 expref: 64 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.941257:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448477.941260:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788448477.941265:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:3.0:1788448477.941339:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12357:x1875323801128576:12345-192.168.206.21@tcp:101:cat.0 Request processed in 596us (911us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788448477.941368:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 182 00000100:00100000:0.0:1788448477.964075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448477.964515:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801128704 00000100:00100000:1.0:1788448477.964529:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801128704 00000100:00100000:1.0:1788448477.964606:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 183 00000100:00100000:1.0:1788448477.964619:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12358:x1875323801128704:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448477.964652:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448477.964680:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e084d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.964768:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b80435d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.964783:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b80435d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.964796:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b80435d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448477.964866:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788448477.964870:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448477.964934:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b80435d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.964967:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e084d expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.965002:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b80435d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e084d expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448477.965028:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448477.965032:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448477.965036:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fcc00, rc 0) 00000100:00100000:1.0:1788448477.965121:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12358:x1875323801128704:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 504us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448477.965130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 183 00000100:00100000:1.0:1788448477.970132:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.970301:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129088 00000100:00100000:0.0:1788448477.970313:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129088 00000100:00100000:0.0:1788448477.970396:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1788448477.970407:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12358:x1875323801129088:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448477.970736:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12358:x1875323801129088:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 330us (617us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788448477.970745:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:2.0:1788448477.972866:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448477.973150:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129216 00000100:00100000:0.0:1788448477.973160:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129216 00000100:00100000:0.0:1788448477.973252:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1788448477.973263:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc184e66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12358:x1875323801129216:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:0.0:1788448477.973296:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788448477.973326:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8042ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0831 expref: 66 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.973350:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b804348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0846 expref: 65 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.973363:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8041ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07eb expref: 64 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.973373:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448477.973378:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448477.973435:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc184e66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12358:x1875323801129216:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 174us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448477.973442:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:1.0:1788448477.975164:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448477.975242:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129344 00000100:00100000:3.0:1788448477.975252:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129344 00000100:00100000:3.0:1788448477.975312:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00100000:3.0:1788448477.975322:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12358:x1875323801129344:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:3.0:1788448477.975470:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.975489:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.975501:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448477.979710:0:13810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788448477.979838:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12358:x1875323801129344:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 4512us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.979849:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 184 00000100:00100000:1.0:1788448478.000994:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.001114:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129472 00000100:00100000:0.0:1788448478.001131:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129472 00000100:00100000:0.0:1788448478.001266:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 185 00000100:00100000:0.0:1788448478.001310:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12360:x1875323801129472:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448478.001337:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448478.001365:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80436b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0854 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001465:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001482:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001495:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001508:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001516:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001522:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001609:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001618:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001625:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448478.001688:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788448478.001692:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448478.001728:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001741:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001749:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001756:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001763:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001769:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448478.001774:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001782:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001806:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448478.001810:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448478.001816:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001822:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804372 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001849:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001855:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001862:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001867:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448478.001870:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001877:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001935:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:0.0:1788448478.001937:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448478.001941:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001947:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b804379 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.001990:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80436b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 65 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.002007:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.002027:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448478.002029:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448478.002033:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448478.002133:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12360:x1875323801129472:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 825us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.002142:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 185 00000040:00080000:1.0:1788448478.014164:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448478.014177:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448478.014222:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788448478.014233:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448478.014421:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e23100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826362368:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788448478.014770:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448478.019838:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.021614:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e23100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826362368:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448478.022618:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129600 00000100:00100000:0.0:1788448478.022632:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129600 00000100:00100000:0.0:1788448478.022718:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:0.0:1788448478.022731:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12364:x1875323801129600:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448478.022774:0:6517:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448478.023413:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083418700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12364:x1875323801129600:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 682us (3586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.023424:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 186 00000100:00100000:2.0:1788448478.029612:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448478.029742:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129728 00000100:00100000:1.0:1788448478.029754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129728 00000100:00100000:1.0:1788448478.030068:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:1.0:1788448478.030083:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12364:x1875323801129728:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788448478.030187:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.030208:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.030243:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.030960:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.030984:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.030998:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031035:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031045:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031052:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448478.031120:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788448478.031125:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448478.031138:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031150:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031157:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031183:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031188:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.031192:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031199:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031211:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:1.0:1788448478.031215:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.031219:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031226:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804387 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031242:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031248:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031253:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031258:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.031262:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031278:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031286:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9fc08319c500) 00010000:00010000:1.0:1788448478.031288:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.031291:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031297:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b80438e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031310:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031317:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031322:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031327:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.031330:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031335:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031342:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448478.031345:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.031347:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.031363:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804395 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448478.031460:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12364:x1875323801129728:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 1377us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448478.031470:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 187 00000100:00100000:2.0:1788448478.034379:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.034478:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801129984 00000100:00100000:3.0:1788448478.034490:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801129984 00000100:00100000:3.0:1788448478.034566:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 188 00000100:00100000:3.0:1788448478.034578:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12364:x1875323801129984:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448478.034604:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448478.034629:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b80439c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e085b expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.034962:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035049:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035065:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448478.035079:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788448478.035402:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035411:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035418:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035424:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448478.035429:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035436:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035450:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:3.0:1788448478.035453:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448478.035458:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.035547:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.035723:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b80439c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e085b expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.035736:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:2.0:1788448478.035739:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448478.035749:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b80439c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e085b expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.035762:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:2.0:1788448478.036229:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12364:x1875323801129984:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1650us (1863us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788448478.036239:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 188 00000100:00100000:1.0:1788448478.043225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.043349:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801130112 00000100:00100000:3.0:1788448478.043362:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801130112 00000100:00100000:3.0:1788448478.043427:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 189 00000100:00100000:3.0:1788448478.043440:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12364:x1875323801130112:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788448478.043489:0:9023:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788448478.043640:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12364:x1875323801130112:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 203us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.043649:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 189 00000100:00100000:3.0:1788448478.057146:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448478.057245:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801130368 00000100:00100000:1.0:1788448478.057258:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801130368 00000100:00100000:1.0:1788448478.057332:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 190 00000100:00100000:1.0:1788448478.057346:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12364:x1875323801130368:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448478.057384:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448478.057388:0:13810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788448478.057422:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b80435d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e084d expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.057446:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448478.057452:0:13810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448478.057470:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0862 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448478.058679:0:13810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788448478.058930:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8043b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.058949:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8043b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.058986:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8043b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.059103:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0862 expref: 67 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.059127:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8043b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0862 expref: 66 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.059138:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c500) 00010000:00010000:1.0:1788448478.059141:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448478.059145:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd600, rc 0) 00000100:00100000:1.0:1788448478.059235:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12364:x1875323801130368:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1891us (2103us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788448478.059246:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 190 00000100:00100000:2.0:1788448478.067327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.067405:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801130624 00000100:00100000:0.0:1788448478.067420:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801130624 00000100:00100000:0.0:1788448478.067497:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:0.0:1788448478.067511:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12364:x1875323801130624:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448478.067600:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448478.067634:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8043b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0862 expref: 66 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067659:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c500) 00010000:00010000:0.0:1788448478.067671:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448478.067720:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067750:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067762:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067782:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067788:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067795:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.067851:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068383:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068396:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068402:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448478.068407:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068416:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068442:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448478.068444:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448478.068449:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068455:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8043c6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068468:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068474:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068480:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068485:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448478.068489:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068495:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068503:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x4382c32d (ffff9fc08336ab00) 00010000:00010000:0.0:1788448478.068505:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448478.068508:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.068514:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8043cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x4382c32d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.068636:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08373df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12364:x1875323801130624:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1126us (1321us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448478.068646:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 191 00000100:00100000:3.0:1788448478.071718:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.071936:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801130752 00000100:00100000:0.0:1788448478.071950:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801130752 00000100:00100000:1.0:1788448478.072327:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 192 00000100:00100000:1.0:1788448478.072343:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc081a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12364:x1875323801130752:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448478.072371:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448478.072400:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043d4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0869 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.072445:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.072460:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.072492:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.072627:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.072648:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.072657:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:1.0:1788448478.072661:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448478.072665:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fcc00, rc 0) 00000100:00100000:1.0:1788448478.072757:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc081a68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12364:x1875323801130752:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 418us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448478.072765:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 192 00000100:00100000:3.0:1788448478.087621:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448478.087759:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801131008 00000100:00100000:1.0:1788448478.087773:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801131008 00000100:00100000:1.0:1788448478.087852:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:1.0:1788448478.087865:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12364:x1875323801131008:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448478.088016:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.088037:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.088051:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448478.088299:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788448478.088311:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395433428474ns, next at 396433425485ns, rc = 0 00000004:00010000:1.0:1788448478.088368:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024878e7d reply state 000000006c36544e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.088382:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.088391:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:1.0:1788448478.088394:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788448478.088398:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448478.088527:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:12364:x1875323801131008:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 663us (959us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788448478.088535:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 193 00000100:00100000:2.0:1788448478.092251:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.092455:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801131136 00000100:00100000:3.0:1788448478.092470:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801131136 00000100:00100000:3.0:1788448478.092546:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:3.0:1788448478.092560:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:12364:x1875323801131136:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448478.092593:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448478.092619:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0870 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.092695:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 69 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.092713:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 69 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.092768:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:3.0:1788448478.092771:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448478.092776:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ec00, rc 0) 00000100:00100000:3.0:1788448478.092858:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+69:12364:x1875323801131136:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 300us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.092866:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 194 00000100:00100000:3.0:1788448478.098336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448478.098431:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801131264 00000100:00100000:2.0:1788448478.098443:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801131264 00000100:00100000:2.0:1788448478.098547:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1788448478.098561:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+6:2398:x1875323801131264:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788448478.098854:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb797b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801131264:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 295us (531us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788448478.098864:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00080000:3.0:1788448478.099048:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448478.104234:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.104338:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801131520 00000100:00100000:0.0:1788448478.104347:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801131520 00000100:00100000:0.0:1788448478.104416:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1788448478.104426:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+69:12364:x1875323801131520:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448478.105274:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+70:12364:x1875323801131520:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 845us (1045us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788448478.105284:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1788448478.110001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.110144:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801131776 00000100:00100000:0.0:1788448478.110157:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801131776 00000100:00100000:0.0:1788448478.110244:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:0.0:1788448478.110256:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+70:12364:x1875323801131776:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448478.110414:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+70:12364:x1875323801131776:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 159us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.110422:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 195 00000100:00100000:2.0:1788448478.115749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.115835:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801131904 00000100:00100000:3.0:1788448478.115940:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801131904 00000100:00100000:3.0:1788448478.116540:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:3.0:1788448478.116556:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+70:12364:x1875323801131904:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448478.116582:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448478.116608:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8043f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0877 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.116693:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8043f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.116709:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8043f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.116723:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8043f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448478.116775:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448478.116797:0:6518:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8043f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.116857:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8043f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0877 expref: 72 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.116900:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8043f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0877 expref: 71 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.116911:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:3.0:1788448478.116914:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788448478.116918:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f400, rc 0) 00000100:00100000:3.0:1788448478.117007:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+71:12364:x1875323801131904:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 455us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.117015:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 196 00000100:00100000:2.0:1788448478.127760:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.127833:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132032 00000100:00100000:0.0:1788448478.127852:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132032 00000100:00100000:0.0:1788448478.127936:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1788448478.127948:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801132032:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448478.127969:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448478.128126:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e087e expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448478.128158:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998edd, blocks: 0x0 00010000:00010000:0.0:1788448478.128182:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788448478.128187:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448478.128199:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.128222:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.128239:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f600, rc 0) 00000100:00100000:0.0:1788448478.128521:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801132032:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 572us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.128529:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1788448478.139280:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.139378:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132288 00000100:00100000:3.0:1788448478.139392:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132288 00000100:00100000:3.0:1788448478.139572:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:3.0:1788448478.139586:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+71:12364:x1875323801132288:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788448478.139757:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+71:12364:x1875323801132288:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 173us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.139766:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 197 00000100:00100000:0.0:1788448478.148287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.148494:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132416 00000100:00100000:3.0:1788448478.148506:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132416 00000100:00100000:3.0:1788448478.148577:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:3.0:1788448478.148590:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:12364:x1875323801132416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448478.148613:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448478.148636:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0885 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.148683:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.148694:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448478.148700:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448478.148706:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.148748:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.148764:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448478.148781:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb795500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875323826362496:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448478.149241:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448478.157502:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb795500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8433:1875323826362496:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448478.157547:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.157573:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1fa00, rc 0) 00000100:00100000:3.0:1788448478.157647:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:12364:x1875323801132416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 9059us (9374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.157657:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:0.0:1788448478.161604:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448478.162334:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132544 00000100:00100000:2.0:1788448478.162348:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132544 00010000:00010000:2.0:1788448478.162483:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448478.162574:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:2.0:1788448478.162586:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801132544:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448478.162620:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448478.162646:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.162662:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.162690:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b8043fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e087e expref: 9 pid: 8434 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.162709:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448478.162714:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448478.162723:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.162734:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.162781:0:6502:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448478.162799:0:6502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1875323826362624:192.168.206.21@tcp:105: 00000100:00100000:2.0:1788448478.163007:0:6502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448478.172258:0:6502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6502:1875323826362624:192.168.206.21@tcp:105: 00010000:00010000:2.0:1788448478.172294:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448478.173401:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.173722:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132672 00000100:00100000:3.0:1788448478.173731:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132672 00002000:00100000:3.0:1788448478.173778:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9fc083688e00 x1875323801132672/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:714/0 lens 504/0 e 0 to 0 dl 1788448489 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448478.173789:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083688e00 with x1875323801132672 ext(0->8) 00002000:00010000:3.0:1788448478.173794:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc083688e00 00000100:00100000:3.0:1788448478.173876:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1788448478.173907:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801132672:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788448478.174519:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2398:x1875323801132544:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 11924us (12918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448478.174535:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:3.0:1788448478.176111:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2398:x1875323801132672:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 2181us (2693us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788448478.176127:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00002000:00100000:3.0:1788448478.176147:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9fc083688e00 x1875323801132672/t4294967315(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:714/0 lens 504/448 e 0 to 0 dl 1788448489 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448478.176157:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083688e00 with x1875323801132672 ext(0->8) 00002000:00010000:3.0:1788448478.176162:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc083688e00 00000100:00100000:0.0:1788448478.188505:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.188656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132800 00000100:00100000:3.0:1788448478.188669:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132800 00000100:00100000:3.0:1788448478.188748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 198 00000100:00100000:3.0:1788448478.188762:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+71:12364:x1875323801132800:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788448478.192380:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:3.0:1788448478.192407:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:3.0:1788448478.192488:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788448478.192507:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc083d2a300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788448478.192513:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083d2a600 00000020:00080000:3.0:1788448478.192516:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc08330c200 00000020:00080000:3.0:1788448478.192573:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788448478.192643:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788448478.192804:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:12364:x1875323801132800:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 4039us (4308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.192816:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 198 00010000:00010000:1.0:1788448478.193146:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193159:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193168:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193181:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.193186:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193194:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193223:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9fc08319c600) 00010000:00010000:1.0:1788448478.193227:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.193232:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193239:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031e00/0xf45a9e4e6b80412d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193259:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193265:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193272:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193277:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180031600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.193280:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193286:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193294:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448478.193296:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.193299:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193305:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031600/0xf45a9e4e6b804134 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193330:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193336:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193342:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193348:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.193362:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193368:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193377:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42bc00) 00010000:00010000:1.0:1788448478.193379:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.193382:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193387:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804173 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193405:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193411:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193417:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193428:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.193431:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193438:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193447:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448478.193449:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.193452:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193458:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804276 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193471:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193788:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193797:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193803:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.193806:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193812:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.193832:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448478.193834:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.193837:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194267:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b804299 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194284:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194290:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194296:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194302:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.194305:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194312:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194322:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448478.194324:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448478.194327:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194333:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8042df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194544:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194552:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194558:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194563:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448478.194566:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194572:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194582:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:1.0:1788448478.194584:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788448478.194587:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.194592:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8043e2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448478.195682:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.195744:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801132928 00000100:00100000:3.0:1788448478.195756:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801132928 00000100:00100000:3.0:1788448478.195813:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:3.0:1788448478.195824:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2398:x1875323801132928:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788448478.195849:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448478.195874:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826362752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788448478.196589:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448478.196662:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826362880:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788448478.196708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448478.196832:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826362752 00000100:00100000:0.0:1788448478.196848:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826362752 00000100:00100000:0.0:1788448478.196990:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826362880 00000100:00100000:0.0:1788448478.196995:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826362880 00000100:00100000:0.0:1788448478.197029:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448478.197038:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826362752:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1788448478.198830:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788448478.200245:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00002000:00010000:1.0:1788448478.200447:0:8539:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788448478.200452:0:8539:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788448477 00002000:00010000:1.0:1788448478.200455:0:8539:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788448478.200457:0:8539:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788448477 -> 1788448477 00002000:00010000:1.0:1788448478.200460:0:8539:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788448478.200574:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826362752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3532us (3983us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788448478.200597:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448478.200634:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448478.200649:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826362880:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788448478.200687:0:8539:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00000004:00080000:2.0:1788448478.200813:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083f78380/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788448478.200822:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f78380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826362752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788448478.201089:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801132928:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 5256us (5407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.201117:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00002000:00010000:1.0:1788448478.201294:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a998edb, atime: 0x6a998edb, ctime: 0x6a998edb, blocks: 0x8 00010000:00010000:1.0:1788448478.201305:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.201324:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:1.0:1788448478.201330:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448478.201337:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.204535:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.204563:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.204573:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.204611:0:8539:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448478.204649:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448478.204662:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.204676:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448478.204681:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.204693:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.204714:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.204722:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0cf126/0xf45a9e4e6b80440c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.204744:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448478.204748:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448478.204992:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448478.205598:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826362880:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4948us (8883us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788448478.205611:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:0.0:1788448478.206049:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083f7a680/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788448478.206062:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826362880:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788448478.208662:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448478.208838:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448478.208965:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801133184 00000100:00100000:2.0:1788448478.208978:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801133184 00000100:00100000:2.0:1788448478.209042:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:2.0:1788448478.209053:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:12364:x1875323801133184:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788448478.209118:0:13810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448478.209143:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8043f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0877 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.209164:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:2.0:1788448478.209169:0:13810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448478.209200:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.209213:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.209223:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448478.209334:0:13810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079f7c7e9 reply state 00000000f053bbba transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.209346:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.209369:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:2.0:1788448478.209372:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448478.209376:0:13810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448478.209488:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:12364:x1875323801133184:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 435us (656us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788448478.209496:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 199 00000100:00100000:3.0:1788448478.211992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448478.212297:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801133312 00000100:00100000:1.0:1788448478.212310:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801133312 00000100:00100000:1.0:1788448478.212386:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:1.0:1788448478.212400:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801133312:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788448478.212607:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788448478.212612:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788448477 -> 1788448477 00002000:00010000:1.0:1788448478.212614:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788448475 00002000:00010000:1.0:1788448478.212616:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788448477 -> 1788448477 00002000:00010000:1.0:1788448478.212618:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788448478.212702:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801133312:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 304us (733us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788448478.212710:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:3.0:1788448478.216544:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448478.216621:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801133568 00000100:00100000:2.0:1788448478.216636:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801133568 00000100:00100000:2.0:1788448478.216714:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 200 00000100:00100000:2.0:1788448478.216725:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:12364:x1875323801133568:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788448478.216866:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.216984:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.216996:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.217033:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.217047:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 20 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448478.217063:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826363008:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448478.217170:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448478.221139:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.221254:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826363008:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448478.221307:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.222055:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801133696 00000100:00100000:0.0:1788448478.222070:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801133696 00010000:00010000:0.0:1788448478.222132:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 21 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.222187:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:0.0:1788448478.222257:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:2398:x1875323801133696:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448478.222272:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448478.222280:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 21 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.222294:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 21 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.222317:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8043db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0869 expref: 21 pid: 6517 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.222332:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:0.0:1788448478.222337:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.222348:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.222355:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.222398:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448478.223676:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:2398:x1875323801133696:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1414us (2540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.223691:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 90 00010000:00010000:3.0:1788448478.225119:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225136:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225175:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225182:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225205:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225211:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448478.225216:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225225:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225241:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:3.0:1788448478.225245:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788448478.225249:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.225256:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80441a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448478.225346:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:12364:x1875323801133568:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 8620us (8814us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788448478.225356:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 200 00000100:00100000:2.0:1788448478.230494:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.230566:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801133824 00000100:00100000:0.0:1788448478.230581:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801133824 00000100:00100000:0.0:1788448478.230657:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1788448478.230671:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b5e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801133824:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788448478.230714:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.230743:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.230753:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448478.230770:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448478.230775:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.230817:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.230834:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 8 pid: 8433 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.230853:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1875323826363136:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448478.231005:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184ee3780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448478.235813:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.235846:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8434:1875323826363136:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448478.235933:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448478.236118:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801133952 00000100:00100000:1.0:1788448478.236129:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801133952 00010000:00010000:1.0:1788448478.236176:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 9 pid: 8433 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448478.236223:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:1.0:1788448478.236236:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801133952:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448478.236254:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448478.236297:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 9 pid: 8433 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.236316:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 9 pid: 8433 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.237179:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804405 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0885 expref: 9 pid: 8433 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.237203:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448478.237208:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448478.237215:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.237226:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.237430:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448478.237431:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.237452:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.237480:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.237488:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.237497:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.237504:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448478.237509:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448478.237515:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801133952:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1281us (1712us total) trans 0 rc 0/0 00010000:00010000:3.0:1788448478.237519:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448478.237524:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 91 00010000:00010000:3.0:1788448478.237533:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.237540:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070512ee6/0xf45a9e4e6b804421 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448478.237606:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b5e8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801133824:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 6939us (7126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.237615:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:3.0:1788448478.241718:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.241817:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801134208 00000100:00100000:0.0:1788448478.241832:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801134208 00000100:00100000:0.0:1788448478.241956:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 201 00000100:00100000:0.0:1788448478.241970:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:12364:x1875323801134208:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448478.242047:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.242064:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.242073:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.242124:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.242139:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 19 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.242153:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826363264:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448478.242243:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184ee3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448478.245682:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826363264:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448478.245721:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448478.248581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448478.248705:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801134336 00000100:00100000:1.0:1788448478.248716:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801134336 00010000:00010000:1.0:1788448478.248768:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 20 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448478.248825:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:1.0:1788448478.248838:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:2399:x1875323801134336:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448478.248857:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448478.248866:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 20 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.248931:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 20 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.248956:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b80426f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e080e expref: 20 pid: 6518 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.248978:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:1.0:1788448478.248984:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.248995:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.249003:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.249042:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448478.249128:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:2399:x1875323801134336:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 292us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448478.249137:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 92 00010000:00010000:3.0:1788448478.249706:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.249717:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.249996:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.250012:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.250022:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.250061:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.250078:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 19 pid: 13811 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448478.250114:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826363392:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448478.250191:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448478.254568:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.254612:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801134464 00000100:00100000:0.0:1788448478.254623:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801134464 00010000:00010000:0.0:1788448478.254672:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 20 pid: 13811 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.254735:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:0.0:1788448478.254747:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:2398:x1875323801134464:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448478.254765:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448478.254773:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 20 pid: 13811 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.254799:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 20 pid: 13811 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.254826:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:0.0:1788448478.254832:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.254842:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.254849:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.254872:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448478.254958:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:2398:x1875323801134464:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 212us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.254966:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 93 00010000:00010000:2.0:1788448478.255839:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8043e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0870 expref: 19 pid: 13811 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448478.255862:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826363392:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448478.255903:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.255913:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.255920:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448478.256056:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788448478.256204:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788448478.256242:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788448478.256400:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826363520:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788448478.256466:0:9023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448478.256497:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448478.257131:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826363520 00000100:00100000:0.0:1788448478.257141:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826363520 00000100:00100000:0.0:1788448478.257325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788448478.257337:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9023:x1875323826363520:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788448478.257467:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:9023:x1875323826363520:12345-0@lo:1000:mdt00_003.0 Request processed in 132us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.257474:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788448478.257607:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826363520:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788448478.257762:0:9023:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788448478.257907:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826363648:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788448478.257948:0:9023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448478.261974:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448478.262122:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826363648 00000100:00100000:1.0:1788448478.262135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826363648 00000100:00100000:1.0:1788448478.262206:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788448478.262218:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9023:x1875323826363648:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788448478.262537:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9023:x1875323826363648:12345-0@lo:1000:mdt00_003.0 Request processed in 319us (4587us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788448478.262546:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788448478.263586:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9023:1875323826363648:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788448478.263649:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263661:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263668:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263675:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448478.263680:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263688:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263707:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:0.0:1788448478.263710:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448478.263716:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263722:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80442f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263751:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263786:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263792:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263798:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448478.263801:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263807:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263816:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448478.263818:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448478.263822:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263827:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b804364 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263854:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263870:0:9023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263898:0:9023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263941:0:9023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 22 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.263965:0:9023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 22 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.263981:0:9023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826363776:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448478.264084:0:9023:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184ee39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448478.270575:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448478.270579:0:9023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9023:1875323826363776:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448478.270612:0:9023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.270642:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801134592 00000100:00100000:0.0:1788448478.270648:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801134592 00010000:00010000:0.0:1788448478.270678:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 23 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448478.270719:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:0.0:1788448478.270728:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:2399:x1875323801134592:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448478.270741:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448478.270747:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 23 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.270759:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 23 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.270780:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804380 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0854 expref: 23 pid: 6519 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.270810:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:0.0:1788448478.270815:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.270823:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.270830:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448478.270860:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448478.270933:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:2399:x1875323801134592:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 205us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.270940:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 94 00010000:00010000:2.0:1788448478.271107:0:9023:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271127:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271138:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271144:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271151:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271157:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448478.271161:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271169:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271179:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448478.271181:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448478.271185:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271190:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804436 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271200:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271205:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271219:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271223:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448478.271227:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271233:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271240:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448478.271242:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448478.271245:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.271251:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804428 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448478.271381:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12364:x1875323801134208:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 29413us (29678us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788448478.271390:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 201 00000020:00080000:2.0:1788448478.271395:0:9023:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788448478.271677:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448478.271682:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448478.273761:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788448478.273776:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448478.275587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448478.275764:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801134848 00000100:00100000:3.0:1788448478.275774:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801134848 00000100:00100000:3.0:1788448478.275833:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:3.0:1788448478.275845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b99850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12364:x1875323801134848:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788448478.276574:0:6520:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788448478.276605:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1788448478.276640:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.276778:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.276791:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.276799:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.276806:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.276812:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448478.276907:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788448478.277025:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b99850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:12364:x1875323801134848:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1179us (1443us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788448478.277046:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000020:00080000:3.0:1788448478.277052:0:6520:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788448478.278411:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448478.278423:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.278435:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448478.278441:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.278451:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.278467:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:1.0:1788448478.278470:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788448478.278475:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.278482:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80443d lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.278496:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448478.278498:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448478.278500:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788448478.834430:0:14659:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448478.834438:0:14659:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448478.834470:0:14659:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788448478.834475:0:14659:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448479.012057:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.012492:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801135104 00000100:00100000:3.0:1788448479.012502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801135104 00000100:00100000:3.0:1788448479.012564:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 202 00000100:00100000:3.0:1788448479.012574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:12382:x1875323801135104:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448479.012596:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.012614:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804444 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e088c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.012705:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b80444b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.012719:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b80444b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.014902:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b80444b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448479.014928:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788448479.015854:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804444 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e088c expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.015877:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b80444b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e088c expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.015924:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448479.015927:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448479.015943:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e400, rc 0) 00000100:00100000:3.0:1788448479.016084:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:12382:x1875323801135104:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 3510us (6124us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788448479.016104:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 202 00000100:00080000:3.0:1788448479.016139:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448479.028288:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.028356:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801135232 00000100:00100000:2.0:1788448479.028366:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801135232 00000100:00100000:2.0:1788448479.028582:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 203 00000100:00100000:2.0:1788448479.028593:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:12382:x1875323801135232:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1788448479.028662:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028690:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028701:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028715:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028723:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028730:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028810:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028819:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028826:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448479.028867:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028906:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028913:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028930:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028936:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.028941:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028948:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.028960:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:2.0:1788448479.028963:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.029030:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029037:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b804459 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029049:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029056:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029062:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029067:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.029070:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029087:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029106:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448479.029109:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.029112:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029118:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804460 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029134:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029140:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029146:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029151:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.029154:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029159:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029166:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448479.029168:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.029170:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.029186:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804467 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.029261:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:12382:x1875323801135232:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 668us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.029269:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 203 00000100:00100000:0.0:1788448479.077962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.078175:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801135488 00000100:00100000:3.0:1788448479.078184:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801135488 00000100:00100000:3.0:1788448479.078250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 204 00000100:00100000:3.0:1788448479.078260:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+25:12385:x1875323801135488:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448479.078290:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.078311:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80446e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0893 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078383:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078398:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078409:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078423:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078430:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078436:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078558:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078567:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078573:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448479.078582:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788448479.078652:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078659:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078666:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078672:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.078676:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078683:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078695:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448479.078698:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448479.078703:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078719:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804475 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078732:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078738:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078744:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078749:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.078752:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078757:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078765:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42cb00) 00010000:00010000:3.0:1788448479.078767:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448479.078770:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078776:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80447c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078813:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b80446e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 28 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078833:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.078846:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.078848:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448479.078850:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f200, rc 0) 00000100:00100000:3.0:1788448479.078957:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12385:x1875323801135488:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 698us (1005us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788448479.078964:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 204 00000100:00100000:3.0:1788448479.085452:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.085545:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801135616 00000100:00100000:0.0:1788448479.085555:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801135616 00000100:00100000:0.0:1788448479.085613:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:0.0:1788448479.085625:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12385:x1875323801135616:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1788448479.085687:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085721:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085731:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085763:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085770:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085777:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085784:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448479.085788:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085794:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085805:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:0.0:1788448479.085808:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448479.085813:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.085819:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804491 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.085930:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12385:x1875323801135616:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 307us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.085944:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 205 00000100:00100000:1.0:1788448479.090547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.090649:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801135872 00000100:00100000:0.0:1788448479.090660:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801135872 00000100:00100000:0.0:1788448479.090716:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:0.0:1788448479.090727:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12385:x1875323801135872:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448479.090956:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+28:12385:x1875323801135872:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 230us (417us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788448479.090964:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:1.0:1788448479.134302:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.134407:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801136128 00000100:00100000:0.0:1788448479.134416:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801136128 00000100:00100000:0.0:1788448479.134485:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 206 00000100:00100000:0.0:1788448479.134495:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+28:11917:x1875323801136128:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1788448479.134517:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448479.134536:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804498 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e089a expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.134644:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.134658:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.134666:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.134694:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.134727:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 29 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.134741:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826363904:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448479.134842:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448479.142940:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826363904:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448479.142972:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448479.144620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.145547:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801136256 00000100:00100000:0.0:1788448479.145559:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801136256 00010000:00010000:0.0:1788448479.145606:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 30 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.145653:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:0.0:1788448479.145663:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:2399:x1875323801136256:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448479.145676:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448479.145683:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 30 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.145696:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 30 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.145718:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804483 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0893 expref: 30 pid: 6517 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.145754:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:0.0:1788448479.145759:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.145768:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.145774:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.146944:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448479.147187:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:2399:x1875323801136256:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1520us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.147198:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00010000:00010000:3.0:1788448479.147372:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.147382:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448479.147401:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788448479.147537:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804498 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 30 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.147556:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 29 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.147564:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.147567:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448479.147570:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:3.0:1788448479.147600:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:11917:x1875323801136128:12345-192.168.206.21@tcp:101:bash.0 Request processed in 13107us (13309us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788448479.147608:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 206 00000100:00100000:1.0:1788448479.158240:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.158335:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801136384 00000100:00100000:3.0:1788448479.158345:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801136384 00000100:00100000:3.0:1788448479.158407:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:3.0:1788448479.158417:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:11917:x1875323801136384:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448479.158452:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.158473:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b8044ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08a1 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.158508:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8044b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.158521:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8044b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.158532:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8044b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.158637:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e200/0xf45a9e4e6b8044ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08a1 expref: 31 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.158654:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8044b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08a1 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.158664:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.158667:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448479.158670:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ec00, rc 0) 00000100:00100000:3.0:1788448479.158732:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11917:x1875323801136384:12345-192.168.206.21@tcp:101:bash.0 Request processed in 316us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.158739:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 207 00000100:00100000:1.0:1788448479.173985:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.174048:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801136640 00000100:00100000:0.0:1788448479.174058:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801136640 00000100:00100000:0.0:1788448479.174125:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 208 00000100:00100000:0.0:1788448479.174136:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:11917:x1875323801136640:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:0.0:1788448479.174343:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.174359:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.174371:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448479.174412:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:0.0:1788448479.174597:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000010793daf reply state 000000007c1ce442 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.174625:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.174633:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:0.0:1788448479.174636:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788448479.174640:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788448479.174682:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:0.0:1788448479.174793:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:11917:x1875323801136640:12345-192.168.206.21@tcp:36:bash.0 Request processed in 657us (815us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788448479.174801:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 208 00000020:00080000:0.0:1788448479.174805:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788448479.180535:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.180602:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801136768 00000100:00100000:2.0:1788448479.180611:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801136768 00000100:00100000:2.0:1788448479.180671:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 209 00000100:00100000:2.0:1788448479.180681:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+34:11917:x1875323801136768:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1788448479.180705:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448479.180723:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b8044c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08a8 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.180789:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b8044c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08a8 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.180804:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b8044c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08a8 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.180822:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:2.0:1788448479.180825:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448479.180828:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331800, rc 0) 00000100:00100000:2.0:1788448479.180909:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:11917:x1875323801136768:12345-192.168.206.21@tcp:101:bash.0 Request processed in 203us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.180916:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 209 00000100:00100000:1.0:1788448479.186611:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.186694:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801136896 00000100:00100000:3.0:1788448479.186704:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801136896 00000100:00100000:3.0:1788448479.186809:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:3.0:1788448479.186819:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:11917:x1875323801136896:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448479.186837:0:8431:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.186858:0:8431:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08af expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448479.186931:0:8431:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a998edd, atime: 0x6a998edb, ctime: 0x6a998edd, blocks: 0x8 00010000:00010000:3.0:1788448479.186954:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:3.0:1788448479.186959:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448479.186978:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.187000:0:8431:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 8 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.187015:0:8431:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e200, rc 0) 00000100:00100000:3.0:1788448479.187078:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:11917:x1875323801136896:12345-192.168.206.21@tcp:101:bash.0 Request processed in 260us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.187086:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:1.0:1788448479.191050:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.191143:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801137024 00000100:00100000:0.0:1788448479.191152:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801137024 00002000:00010000:0.0:1788448479.191191:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788448479.191196:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc1bf7b4380 with x1875323801137024 ext(0->18446744073709551615) 00002000:00010000:0.0:1788448479.191207:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc1bf7b4380. 00000100:00100000:0.0:1788448479.191234:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1788448479.191244:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2398:x1875323801137024:12345-192.168.206.21@tcp:10:bash.0 00002000:00010000:0.0:1788448479.191946:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788448479.191951:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788448477 -> 1788448478 00002000:00010000:0.0:1788448479.191954:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788448475 -> 1788448475 00002000:00010000:0.0:1788448479.191957:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788448477 -> 1788448478 00002000:00010000:0.0:1788448479.191959:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788448479.192167:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801137024:12345-192.168.206.21@tcp:10:bash.0 Request processed in 922us (1124us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788448479.192176:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00002000:00010000:0.0:1788448479.192190:0:8438:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1788448479.192193:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc1bf7b4380 with x1875323801137024 ext(0->18446744073709551615) 00002000:00010000:0.0:1788448479.192199:0:8438:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc1bf7b4380. 00010000:00010000:3.0:1788448479.231441:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448479.291797:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.291995:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801137152 00000100:00100000:2.0:1788448479.292005:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801137152 00000100:00100000:2.0:1788448479.292066:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 210 00000100:00100000:2.0:1788448479.292077:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:12399:x1875323801137152:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:2.0:1788448479.292159:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292176:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292188:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292203:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292211:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292217:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292297:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292305:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292311:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448479.292355:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292384:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292390:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292397:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292403:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.292407:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292414:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292428:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:2.0:1788448479.292431:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.292436:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292443:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b8044d0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292456:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292462:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292468:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292479:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.292482:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292488:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292496:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448479.292498:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.292501:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292507:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b8044d7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292521:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292527:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292533:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292538:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.292541:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292546:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292563:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:2.0:1788448479.292565:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.292568:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.292573:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b8044de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.292648:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:12399:x1875323801137152:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 571us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.292656:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 210 00000100:00100000:0.0:1788448479.350019:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.350195:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801137408 00000100:00100000:3.0:1788448479.350207:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801137408 00000100:00100000:3.0:1788448479.350270:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 211 00000100:00100000:3.0:1788448479.350280:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+35:12402:x1875323801137408:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448479.350313:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.350333:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8044e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08b6 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350407:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350421:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350433:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350446:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350453:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350459:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350613:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8044fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350623:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8044fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350629:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8044fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448479.350639:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788448479.350724:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350731:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350737:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350742:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.350747:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350755:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350766:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448479.350769:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448479.350773:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.350779:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8044ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351846:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351862:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351868:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351922:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.351926:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351933:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351946:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:3.0:1788448479.351949:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448479.351952:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.351959:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b8044f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.352022:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8044e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08b6 expref: 38 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.352037:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8044fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08b6 expref: 37 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.352045:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.352047:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788448479.352050:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e800, rc 0) 00000100:00100000:3.0:1788448479.352134:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12402:x1875323801137408:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 1855us (2124us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788448479.352144:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 211 00000100:00100000:1.0:1788448479.360287:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.360380:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801137536 00000100:00100000:2.0:1788448479.360391:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801137536 00000100:00100000:2.0:1788448479.360457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 212 00000100:00100000:2.0:1788448479.360477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12402:x1875323801137536:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:2.0:1788448479.360540:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.360557:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 37 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.360567:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.360599:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 37 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.360612:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 37 pid: 13811 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.360642:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826364032:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448479.360729:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448479.364385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.364579:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801137792 00000100:00100000:0.0:1788448479.364588:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801137792 00000100:00100000:0.0:1788448479.364640:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:0.0:1788448479.364650:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:6169:x1875323801137792:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788448479.364948:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:6169:x1875323801137792:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 297us (571us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788448479.364956:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448479.365638:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826364032:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448479.365664:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.368574:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.368707:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801137920 00000100:00100000:2.0:1788448479.368716:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801137920 00010000:00010000:2.0:1788448479.368758:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 39 pid: 13811 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.368812:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:2.0:1788448479.368823:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:2398:x1875323801137920:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448479.368837:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448479.368845:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 39 pid: 13811 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.368859:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 39 pid: 13811 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.368912:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b80449f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e089a expref: 39 pid: 13811 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.368927:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:2.0:1788448479.368932:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.368957:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.368966:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.369223:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448479.369288:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:2398:x1875323801137920:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 459us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.369296:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00010000:00010000:3.0:1788448479.372607:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372641:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372683:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372691:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372698:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372704:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.372708:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372716:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372732:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.372735:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448479.372738:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.372744:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b804508 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448479.373071:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12402:x1875323801137536:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 12599us (12799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.373082:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 212 00000100:00100000:0.0:1788448479.376236:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.376312:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801138176 00000100:00100000:3.0:1788448479.376322:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801138176 00000100:00100000:3.0:1788448479.376376:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1788448479.376386:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+37:12402:x1875323801138176:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448479.376671:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:12402:x1875323801138176:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 286us (445us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788448479.376679:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:1.0:1788448479.504545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.504647:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801138432 00000100:00100000:2.0:1788448479.504658:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801138432 00000100:00100000:2.0:1788448479.504717:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 213 00000100:00100000:2.0:1788448479.504728:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+38:12413:x1875323801138432:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:2.0:1788448479.504752:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448479.504771:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80450f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08bd expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.504854:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.504867:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.504878:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.504921:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.504945:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.504953:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505067:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804524 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505077:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505083:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804524 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448479.505103:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788448479.505180:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505188:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505194:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505199:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.505203:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505210:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505233:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:2.0:1788448479.505236:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.505241:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505247:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331000/0xf45a9e4e6b804516 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505260:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505266:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505272:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505452:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.505457:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505464:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505473:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448479.505475:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448479.505478:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505483:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331400/0xf45a9e4e6b80451d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505532:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80450f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08bd expref: 41 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505546:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804524 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08bd expref: 40 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.505554:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:2.0:1788448479.505557:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448479.505559:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330000, rc 0) 00000100:00100000:2.0:1788448479.505621:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:12413:x1875323801138432:12345-192.168.206.21@tcp:101:cat.0 Request processed in 894us (1084us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788448479.505628:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 213 00000100:00100000:1.0:1788448479.511519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.511606:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801138688 00000100:00100000:0.0:1788448479.511616:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801138688 00000100:00100000:0.0:1788448479.511672:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:0.0:1788448479.511682:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+40:12413:x1875323801138688:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:0.0:1788448479.512003:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+41:12413:x1875323801138688:12345-192.168.206.21@tcp:35:cat.0 Request processed in 320us (492us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788448479.512010:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:0.0:1788448479.535314:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.535463:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801138944 00000100:00100000:3.0:1788448479.535473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801138944 00000100:00100000:3.0:1788448479.535531:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 214 00000100:00100000:3.0:1788448479.535541:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+41:12414:x1875323801138944:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788448479.535593:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788448479.535618:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b8044c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08a8 expref: 41 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535637:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804524 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08bd expref: 40 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535648:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8044fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08b6 expref: 39 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535660:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b8044b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08a1 expref: 38 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535669:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.535673:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448479.535692:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535717:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535727:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535743:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535750:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535757:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535844:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535854:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.535861:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448479.536425:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788448479.536437:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 396881554876ns, next at 397881551762ns, rc = 0 00010000:00010000:3.0:1788448479.536483:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536492:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536513:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536520:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536525:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536531:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536588:0:6518:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448479.536607:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536613:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536618:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536623:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.536627:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536633:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536642:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:3.0:1788448479.536645:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788448479.536655:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536661:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804540 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536680:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536686:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536691:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536696:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.536699:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536706:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536713:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448479.536716:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448479.536719:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536725:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b804532 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448479.536734:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c267e0fe reply state 000000009d72d9af transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536756:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.536762:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:3.0:1788448479.536765:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448479.536768:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448479.536854:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:12414:x1875323801138944:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1312us (1548us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788448479.536863:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 214 00010000:00010000:0.0:1788448479.543664:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448479.543677:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.543688:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448479.543706:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.543716:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.543733:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:0.0:1788448479.543736:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448479.543740:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.543747:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b804547 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.543762:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448479.543764:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448479.543766:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448479.590333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.591003:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801139200 00000100:00100000:3.0:1788448479.591015:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801139200 00000100:00100000:3.0:1788448479.591107:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:3.0:1788448479.591117:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+39:12420:x1875323801139200:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:3.0:1788448479.591139:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.591158:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80454e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08c4 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.591257:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.591270:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.591281:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.591293:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.591320:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.591327:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448479.591931:0:13811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788448479.592266:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592276:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592284:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592315:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592322:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592329:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592336:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448479.592339:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592346:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592371:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448479.592374:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448479.592378:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.592384:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804555 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448479.592398:0:13811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c4a6b11 reply state 00000000f36e2d9c transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.593714:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.593729:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:3.0:1788448479.593732:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788448479.593736:0:13811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788448479.593948:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80454e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 42 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.594190:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 41 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.594200:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:3.0:1788448479.594203:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448479.594205:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1e800, rc 0) 00000100:00100000:3.0:1788448479.594282:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+42:12420:x1875323801139200:12345-192.168.206.21@tcp:101:bash.0 Request processed in 3165us (3956us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788448479.594291:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 215 00000100:00100000:1.0:1788448479.607751:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.613647:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801139328 00000100:00100000:2.0:1788448479.613664:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801139328 00000100:00100000:2.0:1788448479.613791:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:2.0:1788448479.613803:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801139328:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:2.0:1788448479.613821:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448479.613841:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08cb expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448479.613867:0:8539:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788448479.613900:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:2.0:1788448479.613905:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448479.613914:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.613951:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 8 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.613963:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331a00, rc 0) 00000100:00100000:2.0:1788448479.614032:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2401:x1875323801139328:12345-192.168.206.21@tcp:101:bash.0 Request processed in 230us (6289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.614039:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00080000:3.0:1788448479.617330:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448479.618860:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448479.618959:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801139456 00000100:00100000:1.0:1788448479.618969:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801139456 00000100:00100000:1.0:1788448479.619019:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:1.0:1788448479.619029:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:12420:x1875323801139456:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448479.619045:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448479.619063:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08d2 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.619106:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 9 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.619115:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448479.619120:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448479.619125:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.619155:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 9 pid: 8539 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.619182:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 9 pid: 8539 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448479.619210:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1875323826364160:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448479.619295:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1922ab3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448479.624365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.624736:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801139584 00000100:00100000:0.0:1788448479.624745:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801139584 00010000:00010000:0.0:1788448479.624784:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 10 pid: 8539 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.624826:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:0.0:1788448479.624836:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2399:x1875323801139584:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448479.624851:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448479.624871:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 10 pid: 8539 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.624912:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 10 pid: 8539 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.624951:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448479.624956:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448479.624977:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.624987:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.625023:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.625038:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875323826364288:192.168.206.21@tcp:105: 00000100:00100000:0.0:1788448479.625129:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a600 going to sleep for 11 seconds 00010000:00010000:1.0:1788448479.625496:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd86692a/0xf45a9e4e6b804571 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08cb expref: 10 pid: 8539 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448479.625510:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8433:1875323826364160:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448479.625530:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 9 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.625541:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd400, rc 0) 00000100:00100000:1.0:1788448479.625586:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:12420:x1875323801139456:12345-192.168.206.21@tcp:101:bash.0 Request processed in 6558us (6735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.625594:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:0.0:1788448479.630447:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6504:1875323826364288:192.168.206.21@tcp:105: 00010000:00010000:0.0:1788448479.630475:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448479.630544:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801139584:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 5708us (6186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.630554:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:0.0:1788448479.631750:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448479.631905:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801139840 00000100:00100000:1.0:1788448479.631913:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801139840 00000100:00100000:1.0:1788448479.631965:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1788448479.631986:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+42:12420:x1875323801139840:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:1.0:1788448479.632277:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12420:x1875323801139840:12345-192.168.206.21@tcp:35:bash.0 Request processed in 301us (530us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788448479.632284:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:2.0:1788448479.814930:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.815107:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801139968 00000100:00100000:0.0:1788448479.815116:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801139968 00000100:00100000:0.0:1788448479.815172:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:0.0:1788448479.815183:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+43:12436:x1875323801139968:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448479.815208:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448479.815240:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80457f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08d9 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.815386:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804586 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.815401:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.815415:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448479.815455:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788448479.815459:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448479.815476:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804586 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.815500:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80457f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d9 expref: 45 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.815517:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804586 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d9 expref: 44 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.815526:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448479.815529:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448479.815532:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448479.815640:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:12436:x1875323801139968:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 458us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.815648:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 216 00000100:00100000:2.0:1788448479.819535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.819644:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801140224 00000100:00100000:3.0:1788448479.819653:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801140224 00000100:00100000:3.0:1788448479.819809:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:3.0:1788448479.819820:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+44:12436:x1875323801140224:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448479.819840:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.819858:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80458d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08e0 expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.820039:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804594 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.820053:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.820064:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804594 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448479.820075:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788448479.820189:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80458d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e0 expref: 47 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.820208:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804594 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e0 expref: 46 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.820216:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:3.0:1788448479.820219:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448479.820222:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1fa00, rc 0) 00000100:00100000:3.0:1788448479.820405:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+46:12436:x1875323801140224:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 585us (878us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788448479.820427:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 217 00000100:00100000:1.0:1788448479.825806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.826713:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801140352 00000100:00100000:3.0:1788448479.826730:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801140352 00000100:00100000:3.0:1788448479.826828:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1788448479.826841:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+46:2398:x1875323801140352:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448479.826859:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448479.826923:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804594 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e0 expref: 46 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.826948:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:3.0:1788448479.826954:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448479.827514:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+45:2398:x1875323801140352:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 673us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.827526:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1788448479.827662:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448479.828659:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801140608 00000100:00100000:1.0:1788448479.828672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801140608 00000100:00100000:1.0:1788448479.828731:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 218 00000100:00100000:1.0:1788448479.828741:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+45:12436:x1875323801140608:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448479.828768:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448479.828804:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8045a2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08e7 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.828955:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b8045a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.828982:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b8045a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.828995:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b8045a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448479.829009:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788448479.829155:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd600/0xf45a9e4e6b8045a2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e7 expref: 48 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.829183:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b8045a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e7 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.829192:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:1.0:1788448479.829195:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788448479.829199:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc400, rc 0) 00000100:00100000:1.0:1788448479.829259:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:12436:x1875323801140608:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 519us (1597us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788448479.829301:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 218 00000100:00100000:1.0:1788448479.839283:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448479.839422:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801140736 00000100:00100000:2.0:1788448479.839435:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801140736 00000100:00100000:2.0:1788448479.839507:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:2.0:1788448479.839616:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2400:x1875323801140736:12345-192.168.206.21@tcp:1:lfs.0 00010000:00010000:2.0:1788448479.839677:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.839701:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.839711:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788448479.839717:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448479.839723:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.839786:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 8 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.839815:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 8 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.839831:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1875323826364416:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448479.839979:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.842729:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8539:1875323826364416:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448479.842771:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448479.843394:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.843484:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801140864 00000100:00100000:0.0:1788448479.843522:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801140864 00002000:00100000:0.0:1788448479.843588:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9fc083ff5f80 x1875323801140864/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:715/0 lens 504/0 e 0 to 0 dl 1788448490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448479.843600:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083ff5f80 with x1875323801140864 ext(0->8) 00010000:00010000:0.0:1788448479.843610:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 9 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.843626:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 9 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448479.843635:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc083ff5f80 00000100:00100000:0.0:1788448479.843676:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:0.0:1788448479.843688:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801140864:12345-192.168.206.21@tcp:4:lfs.0 00000100:00100000:0.0:1788448479.845742:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2399:x1875323801140864:12345-192.168.206.21@tcp:4:lfs.0 Request processed in 2040us (2336us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788448479.845757:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00002000:00100000:0.0:1788448479.845769:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9fc083ff5f80 x1875323801140864/t4294967309(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:715/0 lens 504/448 e 0 to 0 dl 1788448490 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448479.845779:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc083ff5f80 with x1875323801140864 ext(0->8) 00010000:00010000:0.0:1788448479.845798:0:8437:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 11 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.845819:0:8437:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 11 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448479.845848:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9fc083ff5f80 00000100:00100000:2.0:1788448479.849997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.850157:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801140992 00000100:00100000:3.0:1788448479.850170:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801140992 00010000:00010000:3.0:1788448479.850355:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 11 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448479.850405:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:3.0:1788448479.850417:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2399:x1875323801140992:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448479.850454:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788448479.850477:0:6502:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788448479.850481:0:6502:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788448479 00002000:00010000:3.0:1788448479.850483:0:6502:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788448479 00002000:00010000:3.0:1788448479.850485:0:6502:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788448479 00002000:00010000:3.0:1788448479.850487:0:6502:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788448479.850494:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 11 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.850520:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 11 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.850554:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2bb9681/0xf45a9e4e6b804578 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d2 expref: 11 pid: 8433 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.850573:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448479.850578:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448479.850585:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.850596:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.850636:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448479.850806:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2399:x1875323801140992:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 390us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.850815:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 98 00010000:00010000:2.0:1788448479.850959:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.850971:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.850998:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.851008:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.851017:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.851025:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448479.851038:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.851048:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.851060:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.851068:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a44a4be6/0xf45a9e4e6b8045b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.851139:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2400:x1875323801140736:12345-192.168.206.21@tcp:1:lfs.0 Request processed in 11526us (11872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.851148:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:2.0:1788448479.855682:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448479.855758:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801141248 00000100:00100000:1.0:1788448479.855770:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801141248 00000100:00100000:1.0:1788448479.857802:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:1.0:1788448479.857829:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+47:12436:x1875323801141248:12345-192.168.206.21@tcp:35:lfs.0 00000004:00010000:1.0:1788448479.857937:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b8045a9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e7 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448479.858441:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1788448479.858479:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788448479.858949:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:1.0:1788448479.858997:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.859017:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 51 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.859027:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.859071:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 51 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.859097:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 51 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448479.859115:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1875323826364544:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448479.859249:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1922ab780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448479.862770:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6521:1875323826364544:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448479.862869:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.864428:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.864843:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801141376 00000100:00100000:0.0:1788448479.864855:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801141376 00010000:00010000:0.0:1788448479.864935:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 52 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.864990:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:0.0:1788448479.865002:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+52:2399:x1875323801141376:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448479.865019:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448479.865027:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 52 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.865042:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 52 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.865069:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804563 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08c4 expref: 52 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.865100:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:0.0:1788448479.865106:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.865138:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.865146:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.865185:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448479.865259:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+51:2399:x1875323801141376:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 259us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.865267:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 99 00010000:00010000:1.0:1788448479.865400:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.865409:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448479.865558:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1788448479.865688:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1788448479.865790:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1875323826364672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788448479.865857:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.865932:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba21c900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448479.867239:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826364672 00000100:00100000:0.0:1788448479.867253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826364672 00000100:00100000:0.0:1788448479.867638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788448479.867651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186ba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1875323826364672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788448479.867807:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186ba0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6521:x1875323826364672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 159us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.867815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788448479.868157:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1875323826364672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788448479.869036:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1788448479.869145:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1875323826364800:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788448479.871595:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.871643:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448479.871660:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826364800 00000100:00100000:1.0:1788448479.871675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826364800 00000100:00100000:1.0:1788448479.871748:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788448479.871765:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6521:x1875323826364800:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788448479.872066:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6521:x1875323826364800:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 307us (478us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788448479.872075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788448479.873156:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1c380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6521:1875323826364800:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788448479.873237:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1788448479.873289:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.873315:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.873323:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.873328:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fcc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448479.873332:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.873340:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.873355:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:2.0:1788448479.873358:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788448479.873362:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.873367:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fcc00/0xf45a9e4e6b8045be lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448479.873659:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788448479.873722:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788448479.873733:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397218851013ns, next at 398218848934ns, rc = 0 00000001:00080000:2.0:1788448479.873740:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1788448479.873764:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb42ca00) 00010000:00010000:2.0:1788448479.873767:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788448479.873774:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b8045a9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08e7 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.874168:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:12436:x1875323801141248:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 16350us (18499us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788448479.874177:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000020:00080000:2.0:1788448479.874183:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788448479.878607:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448479.878720:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801141504 00000100:00100000:3.0:1788448479.878733:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801141504 00000100:00100000:3.0:1788448479.878842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 219 00000100:00100000:3.0:1788448479.878855:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+54:12436:x1875323801141504:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448479.879262:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448479.879297:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b8045c5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08ee expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.879377:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b8045c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08ee expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.879394:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b8045c5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08ee expref: 55 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.879415:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448479.879419:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448479.879423:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330e00, rc 0) 00000100:00100000:2.0:1788448479.879501:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+55:12436:x1875323801141504:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 648us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.879508:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 219 00000100:00100000:1.0:1788448479.882978:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448479.883132:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801141760 00000100:00100000:1.0:1788448479.883149:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801141760 00000100:00100000:1.0:1788448479.883984:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1788448479.883999:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+55:12436:x1875323801141760:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1788448479.884451:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+56:12436:x1875323801141760:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 454us (1478us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788448479.884460:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:1.0:1788448479.934276:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826365184:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.934335:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826365056:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.934345:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.934407:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826365696:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.934441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.934459:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365184 00000100:00100000:1.0:1788448479.934468:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365184 00000100:00100000:1.0:1788448479.934519:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788448479.934528:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.934536:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826365184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.934571:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.934646:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826364928:0@lo:400:kworker.0 00000100:00100000:2.0:1788448479.934724:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826365312:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936060:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826365184:12345-0@lo:400:kworker.0 Request processed in 1526us (1714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.936071:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788448479.936122:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.936166:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936200:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.936247:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826365184:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936378:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365056 00000100:00100000:1.0:1788448479.936385:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365056 00000100:00100000:1.0:1788448479.936422:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365568 00000100:00100000:1.0:1788448479.936425:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365568 00000100:00100000:1.0:1788448479.936457:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365696 00000100:00100000:1.0:1788448479.936460:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365696 00000100:00100000:1.0:1788448479.936475:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826366208 00000100:00100000:1.0:1788448479.936477:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826366208 00000100:00100000:1.0:1788448479.936490:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788448479.936498:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826365056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936541:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826365056:12345-0@lo:400:kworker.0 Request processed in 44us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.936547:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788448479.936576:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788448479.936583:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826365568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936613:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826365568:12345-0@lo:400:kworker.0 Request processed in 30us (2043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.936689:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1788448479.936704:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788448479.936711:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826365696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936747:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826365696:12345-0@lo:400:kworker.0 Request processed in 37us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.936753:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:1.0:1788448479.936765:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1788448479.936771:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826366208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.936796:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826366208:12345-0@lo:400:kworker.0 Request processed in 26us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.936802:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:1.0:1788448479.936818:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448479.936822:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448479.936842:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc18394d180 x1875323826365696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448479.936852:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826365696:0@lo:400:kworker.0 00010000:00080000:1.0:1788448479.936861:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc18394ca80 x1875323826366208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448479.936869:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826366208:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.937243:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826365568:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.937259:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826366080:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.937329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.937390:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826365056:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.937538:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826366080 00000100:00100000:3.0:1788448479.937546:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826366080 00000100:00100000:3.0:1788448479.937607:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1788448479.937617:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826366080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.937672:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826366080:12345-0@lo:400:kworker.0 Request processed in 57us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.937680:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00080000:3.0:1788448479.937701:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448479.937721:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826366080:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.947584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.947680:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826365824:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.947737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.947782:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826366336:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.947819:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.947856:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365824 00000100:00100000:3.0:1788448479.947865:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365824 00000100:00100000:1.0:1788448479.948050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.948183:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826364928 00000100:00100000:0.0:1788448479.948189:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826364928 00000100:00100000:0.0:1788448479.948229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:0.0:1788448479.948240:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826364928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.948275:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826365440:0@lo:400:kworker.0 00000100:00100000:0.0:1788448479.948313:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826364928:12345-0@lo:400:kworker.0 Request processed in 73us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.948321:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788448479.948327:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.948359:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365440 00000100:00100000:1.0:1788448479.948364:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365440 00000100:00100000:0.0:1788448479.948378:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365312 00000100:00100000:0.0:1788448479.948390:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365312 00000100:00100000:1.0:1788448479.948399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788448479.948407:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826365440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448479.948442:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788448479.948452:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826365312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.948468:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826365440:12345-0@lo:400:kworker.0 Request processed in 51us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.948477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788448479.948496:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826365312:12345-0@lo:400:kworker.0 Request processed in 46us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.948516:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788448479.948532:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826365440:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.948728:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826366336 00000100:00100000:3.0:1788448479.948732:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826366336 00000100:00100000:3.0:1788448479.948771:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788448479.948827:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826365824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.948868:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826365824:12345-0@lo:400:kworker.0 Request processed in 91us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.948875:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788448479.949029:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826365952:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.949065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.949068:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448479.949076:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826366336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.949122:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826366336:12345-0@lo:400:kworker.0 Request processed in 47us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.949129:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788448479.949201:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826364928:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.949247:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826365952 00000100:00100000:3.0:1788448479.949252:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826365952 00000100:00100000:3.0:1788448479.949277:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788448479.949284:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826365952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.949332:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826365952:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.949338:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1788448479.949356:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448479.949361:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448479.949386:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826366336:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.949423:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826365312:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.949450:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826365824:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.950497:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.972749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448479.973190:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801141888 00000100:00100000:0.0:1788448479.973204:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801141888 00000100:00100000:0.0:1788448479.973296:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 220 00000100:00100000:0.0:1788448479.973308:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+56:12446:x1875323801141888:12345-192.168.206.21@tcp:34:lfs.0 00010000:00010000:0.0:1788448479.973412:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973433:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973450:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973463:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973470:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973477:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973592:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973629:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973637:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448479.973699:0:13810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973715:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973722:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973729:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973736:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448479.973741:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973749:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.973774:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448479.973777:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448479.974492:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974844:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8045cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974925:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974933:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974939:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974944:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448479.974948:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974954:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974976:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:0.0:1788448479.974980:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448479.974984:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.974991:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8045d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975002:0:13810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975009:0:13810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975015:0:13810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975026:0:13810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448479.975029:0:13810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975036:0:13810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975044:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448479.975047:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448479.975050:0:13810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.975056:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b8045da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.975188:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+56:12446:x1875323801141888:12345-192.168.206.21@tcp:34:lfs.0 Request processed in 1876us (2448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.975199:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 220 00000100:00100000:2.0:1788448480.018120:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.018229:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801142144 00000100:00100000:3.0:1788448480.018242:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801142144 00000100:00100000:3.0:1788448480.018335:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 221 00000100:00100000:3.0:1788448480.018348:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+56:12449:x1875323801142144:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448480.018374:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448480.018401:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8045e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08f5 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018495:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018513:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018526:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018539:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018546:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018553:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018688:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018710:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018718:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448480.018730:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788448480.018841:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018850:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018858:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018865:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448480.018870:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018878:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018935:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448480.018938:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448480.018943:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018949:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b8045e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018975:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018989:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.018996:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019001:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448480.019004:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019011:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019020:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:3.0:1788448480.019023:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448480.019026:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019032:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b8045ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019072:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b8045e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019098:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 58 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.019107:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:3.0:1788448480.019109:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448480.019118:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1ea00, rc 0) 00000100:00100000:3.0:1788448480.019197:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:12449:x1875323801142144:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 851us (1091us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788448480.019206:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 221 00000100:00100000:1.0:1788448480.023104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.023735:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801142272 00000100:00100000:0.0:1788448480.023749:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801142272 00000100:00100000:0.0:1788448480.023830:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 222 00000100:00100000:0.0:1788448480.023842:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:12449:x1875323801142272:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:0.0:1788448480.024727:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.024752:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.024766:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025112:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025121:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025129:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025136:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448480.025141:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025150:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025163:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.025167:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448480.025172:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.025179:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804604 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.025706:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:12449:x1875323801142272:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 1859us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.025720:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 222 00000100:00100000:2.0:1788448480.029863:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.030861:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801142528 00000100:00100000:1.0:1788448480.030969:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801142528 00000100:00100000:1.0:1788448480.031732:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:1.0:1788448480.031749:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+58:12449:x1875323801142528:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1788448480.032371:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12449:x1875323801142528:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 622us (2520us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1788448480.032381:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1788448480.101559:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.101634:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.101675:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.101713:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.101743:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.101937:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801142912 00000100:00100000:1.0:1788448480.101952:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801142912 00000100:00100000:1.0:1788448480.102041:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:1.0:1788448480.102053:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2401:x1875323801142912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448480.102167:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2401:x1875323801142912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 116us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.102176:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 160 00000100:00100000:0.0:1788448480.102642:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801142656 00000100:00100000:0.0:1788448480.102649:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801142656 00000100:00100000:0.0:1788448480.102695:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 392 00000100:00100000:0.0:1788448480.102712:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801142656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448480.102754:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801142656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.102761:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 392 00000100:00100000:0.0:1788448480.102810:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801142784 00000100:00100000:0.0:1788448480.102815:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801142784 00000100:00100000:0.0:1788448480.102846:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801143168 00000100:00100000:0.0:1788448480.102850:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801143168 00000100:00100000:0.0:1788448480.102870:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801143040 00000100:00100000:0.0:1788448480.102915:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801143040 00000100:00100000:0.0:1788448480.102942:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 343 00000100:00100000:0.0:1788448480.102950:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801142784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448480.103244:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801142784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 294us (1701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.103252:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 343 00000100:00100000:0.0:1788448480.103269:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 344 00000100:00100000:0.0:1788448480.103276:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19211a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801143168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448480.103301:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19211a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801143168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.103307:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 344 00000100:00080000:2.0:1788448480.103931:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448480.103938:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448480.103942:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448480.104100:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:2.0:1788448480.104113:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801143040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448480.104157:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801143040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448480.104164:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:2.0:1788448480.121475:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.121615:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801143424 00000100:00100000:0.0:1788448480.121630:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801143424 00000100:00100000:0.0:1788448480.121723:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 223 00000100:00100000:0.0:1788448480.121735:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12459:x1875323801143424:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1788448480.121768:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.121799:0:13810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788448480.121839:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804586 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08d9 expref: 59 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.121862:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448480.121867:0:13810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448480.121940:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80460b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e08fc expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.122317:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.122332:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.122342:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.122382:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 59 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.122397:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 59 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.122412:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826366464:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448480.122573:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448480.128214:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826366464:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448480.128263:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448480.133583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.133817:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801143552 00000100:00100000:0.0:1788448480.133830:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801143552 00010000:00010000:0.0:1788448480.133928:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 60 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.133981:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:0.0:1788448480.133994:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:2398:x1875323801143552:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.134012:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.134021:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 60 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.134037:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 60 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.134063:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b8045f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08f5 expref: 60 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.134092:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.134098:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.134109:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.134117:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.134156:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.134236:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:2398:x1875323801143552:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 244us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.134245:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 100 00010000:00010000:2.0:1788448480.134674:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.134683:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448480.134706:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788448480.134874:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b80460b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 60 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.134933:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 59 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.134941:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.134952:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788448480.134955:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:2.0:1788448480.135008:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12459:x1875323801143424:12345-192.168.206.21@tcp:101:bash.0 Request processed in 13276us (13549us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788448480.135016:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 223 00000100:00100000:2.0:1788448480.138707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.138807:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801143680 00000100:00100000:1.0:1788448480.138820:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801143680 00000100:00100000:1.0:1788448480.138926:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:1.0:1788448480.138939:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+59:12459:x1875323801143680:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448480.138980:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448480.139006:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804620 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0903 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.139048:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.139066:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.139079:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.139235:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804620 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 61 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.139256:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 60 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.139265:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448480.139268:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448480.139280:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fde00, rc 0) 00000100:00100000:1.0:1788448480.139351:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:12459:x1875323801143680:12345-192.168.206.21@tcp:101:bash.0 Request processed in 415us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.139359:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 224 00000100:00100000:0.0:1788448480.141852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.142107:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801143936 00000100:00100000:2.0:1788448480.142120:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801143936 00000100:00100000:2.0:1788448480.142181:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 225 00000100:00100000:2.0:1788448480.142195:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+60:12459:x1875323801143936:12345-192.168.206.21@tcp:36:bash.0 00010000:00010000:2.0:1788448480.142476:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.142587:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.142601:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448480.142656:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1788448480.142683:0:6518:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfb75783 reply state 0000000088f3ff83 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.142696:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.142704:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.142708:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448480.142711:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448480.142835:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12459:x1875323801143936:12345-192.168.206.21@tcp:36:bash.0 Request processed in 641us (995us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788448480.142865:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 225 00000020:00080000:2.0:1788448480.142872:0:6518:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788448480.146133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.146286:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801144064 00000100:00100000:1.0:1788448480.146299:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801144064 00000100:00100000:1.0:1788448480.146437:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:1.0:1788448480.146450:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12459:x1875323801144064:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448480.146482:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448480.146606:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804635 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e090a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.146718:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.146736:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 64 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.146745:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.146852:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 64 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.146868:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 64 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.147411:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826366592:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448480.147588:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969770c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448480.152024:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.152118:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801144192 00000100:00100000:0.0:1788448480.152129:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801144192 00010000:00010000:0.0:1788448480.152180:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 65 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.152226:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:0.0:1788448480.152237:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:2399:x1875323801144192:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.152254:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.152263:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 65 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.152287:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 65 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.152316:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.152321:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.152341:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.152350:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.152373:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.152460:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:2399:x1875323801144192:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 223us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.152470:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 101 00010000:00010000:1.0:1788448480.153729:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804612 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08fc expref: 64 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.153755:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826366592:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448480.154006:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.154018:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.154024:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448480.154100:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788448480.154105:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448480.154132:0:6519:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.154174:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804635 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 64 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.154191:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 63 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.154201:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448480.154204:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448480.154207:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fce00, rc 0) 00000100:00100000:1.0:1788448480.154273:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12459:x1875323801144064:12345-192.168.206.21@tcp:101:bash.0 Request processed in 7825us (8155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.154292:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 226 00000100:00100000:2.0:1788448480.157203:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.157314:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801144448 00000100:00100000:3.0:1788448480.157326:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801144448 00000100:00100000:3.0:1788448480.157490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:3.0:1788448480.157502:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+63:12459:x1875323801144448:12345-192.168.206.21@tcp:35:bash.0 00000100:00100000:3.0:1788448480.157814:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12459:x1875323801144448:12345-192.168.206.21@tcp:35:bash.0 Request processed in 313us (624us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788448480.157824:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1788448480.201603:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.201730:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801144576 00000100:00100000:1.0:1788448480.201743:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801144576 00000100:00100000:1.0:1788448480.201851:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:1.0:1788448480.201864:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+64:12465:x1875323801144576:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448480.201943:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448480.201980:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804643 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0911 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.202065:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b80464a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.202093:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b80464a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.202108:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b80464a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448480.202163:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788448480.202167:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448480.202189:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b80464a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.202217:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804643 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0911 expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.202238:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b80464a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0911 expref: 65 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.202248:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448480.202252:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448480.202275:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd000, rc 0) 00000100:00100000:1.0:1788448480.202460:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12465:x1875323801144576:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 597us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.202468:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:2.0:1788448480.204782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.204878:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801144704 00000100:00100000:3.0:1788448480.204917:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801144704 00000100:00100000:3.0:1788448480.205000:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 228 00000100:00100000:3.0:1788448480.205011:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12465:x1875323801144704:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448480.205036:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448480.205060:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804651 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0918 expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205157:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205174:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205187:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205201:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205227:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205235:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205327:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205511:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205521:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448480.205574:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788448480.205579:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448480.205601:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205617:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205627:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205634:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205641:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205659:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448480.205664:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205673:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205688:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:3.0:1788448480.205691:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448480.205696:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205702:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e800/0xf45a9e4e6b804658 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205719:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205725:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205731:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205736:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448480.205739:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205745:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205763:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:3.0:1788448480.205766:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448480.205769:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205775:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ee00/0xf45a9e4e6b80465f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205809:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fa00/0xf45a9e4e6b804651 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 67 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205825:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 66 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.205833:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:3.0:1788448480.205836:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448480.205839:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1f200, rc 0) 00000100:00100000:3.0:1788448480.205939:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12465:x1875323801144704:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 928us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448480.205947:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 228 00000100:00100000:2.0:1788448480.209202:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.209303:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.209435:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145088 00000100:00100000:3.0:1788448480.209449:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145088 00000100:00100000:3.0:1788448480.209526:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 229 00000100:00100000:3.0:1788448480.209538:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12465:x1875323801145088:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788448480.209565:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448480.209591:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b80466d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e091f expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.209759:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.209779:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.209803:0:13810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 67 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.209814:0:13810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.209863:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 67 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.209917:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 67 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.209934:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826366720:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448480.210187:0:13810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 67 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.210198:0:13810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 67 pid: 6519 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.210209:0:13810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826366848:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788448480.210244:0:13810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448480.212179:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801144832 00000100:00100000:0.0:1788448480.212195:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801144832 00010000:00010000:0.0:1788448480.212251:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 68 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.212296:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:0.0:1788448480.212308:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:2398:x1875323801144832:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.212326:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.212344:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 68 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.212359:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 68 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.212386:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.212392:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.212411:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.212419:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.212489:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:2398:x1875323801144832:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 183us (3301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.212518:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:2.0:1788448480.214763:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.215123:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145216 00000100:00100000:0.0:1788448480.215135:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145216 00010000:00010000:0.0:1788448480.215187:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 68 pid: 6519 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.215246:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:0.0:1788448480.215257:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:2399:x1875323801145216:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.215276:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.215283:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 68 pid: 6519 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.215299:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 68 pid: 6519 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.215327:0:13187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.215342:0:13187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.215354:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.215364:0:13187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.215388:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.215455:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:2399:x1875323801145216:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 198us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.215479:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 103 00010000:00010000:3.0:1788448480.216031:0:13810:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.21@tcp) returned -22 from blocking AST (req@000000003d62df43 x1875323826366720) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 67 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.216051:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f200/0xf45a9e4e6b804666 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0918 expref: 67 pid: 13811 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.216071:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826366720:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448480.216097:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b80463c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e090a expref: 66 pid: 6519 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.216109:0:13810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13810:1875323826366848:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448480.216134:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:3.0:1788448480.216142:0:13810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.216152:0:13810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.216159:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448480.216183:0:13810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788448480.216474:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ea00/0xf45a9e4e6b80466d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 67 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.216492:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 66 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.216512:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:3.0:1788448480.216515:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448480.216518:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f800, rc 0) 00000100:00100000:3.0:1788448480.216578:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12465:x1875323801145088:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 7042us (7275us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1788448480.216587:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 229 00000100:00100000:0.0:1788448480.219942:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.220070:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145472 00000100:00100000:1.0:1788448480.220094:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145472 00000100:00100000:1.0:1788448480.220177:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:1.0:1788448480.220190:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12465:x1875323801145472:12345-192.168.206.21@tcp:103:lfs.0 00010000:00010000:1.0:1788448480.220210:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448480.220244:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b8045c5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08ee expref: 66 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.220266:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448480.220272:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448480.220820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12465:x1875323801145472:12345-192.168.206.21@tcp:103:lfs.0 Request processed in 630us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.220831:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1788448480.223134:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.223284:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145600 00000100:00100000:1.0:1788448480.223296:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145600 00000100:00100000:1.0:1788448480.223376:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00100000:1.0:1788448480.223388:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12465:x1875323801145600:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:1.0:1788448480.223551:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.223573:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.223588:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448480.223730:0:9023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788448480.224149:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12465:x1875323801145600:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 761us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.224159:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00100000:2.0:1788448480.226172:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.226469:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145728 00000100:00100000:0.0:1788448480.226481:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145728 00000100:00100000:0.0:1788448480.226554:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 231 00000100:00100000:0.0:1788448480.226566:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+65:12465:x1875323801145728:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448480.226591:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.226616:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0926 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.226687:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.226700:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.226726:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.226741:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.226757:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.226761:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448480.226765:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.226811:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f000, rc 0) 00000100:00100000:0.0:1788448480.226921:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12465:x1875323801145728:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 357us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.226930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 231 00010000:00010000:1.0:1788448480.254119:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448480.318228:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448480.318242:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448480.318289:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788448480.318304:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448480.318488:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826366976:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448480.318640:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448480.329091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.329527:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145856 00000100:00100000:1.0:1788448480.329539:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145856 00000100:00100000:1.0:1788448480.329618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 232 00000100:00100000:1.0:1788448480.329631:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801145856:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788448480.329798:0:6519:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788448480.330016:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801145856:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 386us (959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.330025:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 232 00000100:00100000:0.0:1788448480.331557:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826366976:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448480.336075:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.336549:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801145984 00000100:00100000:2.0:1788448480.336563:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801145984 00000100:00100000:2.0:1788448480.336703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 233 00000100:00100000:2.0:1788448480.336716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12466:x1875323801145984:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788448480.336813:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.336833:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.336846:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337116:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337140:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337167:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337196:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337204:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337211:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448480.337257:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788448480.337261:0:6517:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448480.337273:0:6517:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337284:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337290:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337297:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337303:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.337307:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337314:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337331:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:2.0:1788448480.337334:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.337338:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337345:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330e00/0xf45a9e4e6b804690 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337359:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337365:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337370:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337376:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.337379:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337384:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337390:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9fc1bb543d00) 00010000:00010000:2.0:1788448480.337392:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.337395:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337400:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804697 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337601:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337609:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337614:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337619:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.337622:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337629:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337637:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.337639:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.337642:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.337647:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80469e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448480.337955:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12466:x1875323801145984:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 1237us (1890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448480.337965:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 233 00000100:00100000:2.0:1788448480.352500:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.353653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801146240 00000100:00100000:0.0:1788448480.353667:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801146240 00000100:00100000:0.0:1788448480.353731:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:0.0:1788448480.353744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+66:12466:x1875323801146240:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.353764:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.353785:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8046a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e092d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.353918:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.353934:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.353949:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448480.353976:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788448480.354048:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354056:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354064:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354070:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448480.354074:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354081:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354104:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.354106:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448480.354110:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354115:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354152:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8046a5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e092d expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354163:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:0.0:1788448480.354165:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448480.354176:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8046a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e092d expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.354185:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:0.0:1788448480.354246:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801146240:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 504us (1826us total) trans 4294967505 rc 301/301 00000100:00100000:0.0:1788448480.354254:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:2.0:1788448480.363609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.363668:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801146368 00000100:00100000:3.0:1788448480.363679:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801146368 00000100:00100000:3.0:1788448480.363754:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:3.0:1788448480.363766:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801146368:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788448480.363811:0:13810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788448480.364116:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801146368:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 352us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448480.364125:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:1.0:1788448480.371814:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.372932:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801146624 00000100:00100000:0.0:1788448480.372946:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801146624 00000100:00100000:0.0:1788448480.373020:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 236 00000100:00100000:0.0:1788448480.373031:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801146624:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.373051:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.373054:0:9023:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788448480.373078:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b80464a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0911 expref: 67 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.373109:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448480.373113:0:9023:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448480.373126:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8046ba lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0934 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448480.373474:0:9023:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:0.0:1788448480.373620:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046c1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.373634:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.373644:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046c1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.373708:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b8046ba lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0934 expref: 69 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.376032:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046c1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0934 expref: 68 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.376049:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc08336b200) 00010000:00010000:0.0:1788448480.376053:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448480.376057:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e000, rc 0) 00000100:00100000:0.0:1788448480.376142:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:12466:x1875323801146624:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 3110us (4335us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788448480.376152:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 236 00000100:00100000:2.0:1788448480.379699:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.379767:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801146880 00000100:00100000:0.0:1788448480.379777:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801146880 00000100:00100000:0.0:1788448480.379851:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:0.0:1788448480.379862:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:12466:x1875323801146880:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.379953:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.379984:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b8046c1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0934 expref: 68 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380002:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc08336b200) 00010000:00010000:0.0:1788448480.380012:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448480.380036:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380049:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380068:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380098:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380107:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380115:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380159:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380167:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380173:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380178:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448480.380182:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380190:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380199:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:0.0:1788448480.380202:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448480.380205:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380217:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b8046cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380228:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380233:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380239:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380244:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448480.380247:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380253:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380261:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x664a9813 (ffff9fc08336b500) 00010000:00010000:0.0:1788448480.380264:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448480.380267:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.380273:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x664a9813 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.380351:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801146880:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 490us (670us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448480.380358:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:2.0:1788448480.387257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.387376:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801147008 00000100:00100000:3.0:1788448480.387386:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801147008 00000100:00100000:3.0:1788448480.387462:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 238 00000100:00100000:3.0:1788448480.387475:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+67:12466:x1875323801147008:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448480.387496:0:13810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448480.387522:0:13810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b8046dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e093b expref: -99 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.387818:0:13810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.387854:0:13810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.387865:0:13810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.388411:0:13810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b8046dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 69 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.388431:0:13810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 68 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.388440:0:13810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:3.0:1788448480.388442:0:13810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448480.388446:0:13810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152ec00, rc 0) 00000100:00100000:3.0:1788448480.388516:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:12466:x1875323801147008:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1043us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448480.388524:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 238 00000100:00100000:2.0:1788448480.398936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.399712:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801147264 00000100:00100000:1.0:1788448480.399725:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801147264 00000100:00100000:1.0:1788448480.399805:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 239 00000100:00100000:1.0:1788448480.399818:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+68:12466:x1875323801147264:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448480.399927:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.399944:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.399955:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448480.400347:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:1.0:1788448480.400395:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000031bc7210 reply state 00000000039b6502 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.400408:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.400416:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:1.0:1788448480.400418:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788448480.400422:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448480.400519:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+70:12466:x1875323801147264:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 702us (1633us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788448480.400527:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 239 00000100:00100000:2.0:1788448480.404652:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.404761:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801147392 00000100:00100000:0.0:1788448480.404779:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801147392 00000100:00100000:0.0:1788448480.404871:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 240 00000100:00100000:0.0:1788448480.404917:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+70:12466:x1875323801147392:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.404949:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.404988:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0942 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.405067:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 71 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.405095:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 71 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.405120:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:0.0:1788448480.405124:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448480.405129:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b800, rc 0) 00000100:00100000:0.0:1788448480.405277:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+71:12466:x1875323801147392:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 395us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.405285:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 240 00000100:00100000:2.0:1788448480.409235:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.409345:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801147520 00000100:00100000:3.0:1788448480.409355:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801147520 00000100:00100000:3.0:1788448480.409410:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:3.0:1788448480.409422:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801147520:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788448480.409650:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2399:x1875323801147520:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 229us (422us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788448480.409668:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:2.0:1788448480.413274:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.413832:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801147776 00000100:00100000:1.0:1788448480.413849:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801147776 00000100:00100000:1.0:1788448480.413946:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:1.0:1788448480.414036:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+71:12466:x1875323801147776:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788448480.414535:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+72:12466:x1875323801147776:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 578us (1271us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788448480.414544:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1788448480.426113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.432051:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148032 00000100:00100000:1.0:1788448480.432068:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148032 00000100:00100000:1.0:1788448480.432158:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:1.0:1788448480.432171:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+72:12466:x1875323801148032:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448480.432410:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+72:12466:x1875323801148032:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 240us (6305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.432437:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:1.0:1788448480.446227:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826367104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448480.446298:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448480.446793:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826367104 00000100:00100000:2.0:1788448480.446802:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826367104 00000100:00100000:2.0:1788448480.446877:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788448480.446918:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1875323826367104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448480.446940:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448480.446998:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3646:x1875323826367104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448480.447005:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788448480.447156:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448480.447237:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826367104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448480.452506:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448480.452525:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826367232:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448480.452599:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448480.452747:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826367232 00000100:00100000:0.0:1788448480.452754:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826367232 00000100:00100000:0.0:1788448480.452807:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788448480.452816:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826367232:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448480.452836:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448480.452877:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826367232:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.452911:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788448480.452950:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826367232:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448480.453638:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.453727:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148160 00000100:00100000:0.0:1788448480.453731:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148160 00000100:00100000:0.0:1788448480.453766:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:0.0:1788448480.453773:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+72:12466:x1875323801148160:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.454042:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.454062:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b8046f9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0949 expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.454132:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804700 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.454146:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.454156:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448480.454192:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448480.454205:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804700 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.454227:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ba00/0xf45a9e4e6b8046f9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0949 expref: 74 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.454243:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804700 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0949 expref: 73 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.454263:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:0.0:1788448480.454266:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788448480.454269:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448480.454312:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+73:12466:x1875323801148160:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 539us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.454319:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:2.0:1788448480.474594:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.474689:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148288 00000100:00100000:1.0:1788448480.474699:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148288 00000100:00100000:1.0:1788448480.474760:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:1.0:1788448480.474771:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+10:2398:x1875323801148288:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448480.474799:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448480.474819:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0950 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448480.474844:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998ee0, blocks: 0x0 00010000:00010000:1.0:1788448480.474862:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1788448480.474866:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448480.474874:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.474928:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.474941:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd000, rc 0) 00000100:00100000:1.0:1788448480.475138:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:2398:x1875323801148288:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 368us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.475146:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:2.0:1788448480.478127:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.484312:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148544 00000100:00100000:0.0:1788448480.484328:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148544 00000100:00100000:0.0:1788448480.484401:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 243 00000100:00100000:0.0:1788448480.484413:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+73:12466:x1875323801148544:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448480.484537:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+73:12466:x1875323801148544:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 126us (6418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.485134:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 243 00000100:00100000:3.0:1788448480.489875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.490048:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148672 00000100:00100000:0.0:1788448480.490058:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148672 00000100:00100000:0.0:1788448480.490120:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:0.0:1788448480.490132:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+11:12466:x1875323801148672:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.490150:0:8539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.490169:0:8539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0957 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.490201:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.490222:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448480.490226:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448480.490232:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.490267:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.490282:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.490298:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826367360:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448480.490400:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448480.499226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.499342:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826367360:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448480.499379:0:8539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 12 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.499406:0:8539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e000, rc 0) 00000100:00100000:0.0:1788448480.499481:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:12466:x1875323801148672:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 9350us (9613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.499491:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:3.0:1788448480.500160:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148800 00000100:00100000:3.0:1788448480.500169:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148800 00010000:00010000:3.0:1788448480.500202:0:13187:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.500241:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:3.0:1788448480.500251:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:2398:x1875323801148800:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448480.500265:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448480.500289:0:13187:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.500303:0:13187:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.500326:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804707 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0950 expref: 12 pid: 8434 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.500344:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448480.500348:0:13187:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448480.500357:0:13187:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.500368:0:13187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.500404:0:13187:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 11 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.500725:0:13187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13187:1875323826367488:192.168.206.21@tcp:105: 00000100:00100000:3.0:1788448480.500812:0:13187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448480.504461:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.504919:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801148928 00000100:00100000:0.0:1788448480.504936:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801148928 00002000:00100000:0.0:1788448480.504995:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9fc08368bb80 x1875323801148928/t0(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:716/0 lens 504/0 e 0 to 0 dl 1788448491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448480.505019:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc08368bb80 with x1875323801148928 ext(0->12) 00002000:00010000:0.0:1788448480.505025:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc08368bb80 00000100:00100000:0.0:1788448480.505057:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:0.0:1788448480.505068:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+12:2399:x1875323801148928:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788448480.507392:0:13187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:13187:1875323826367488:192.168.206.21@tcp:105: 00010000:00010000:3.0:1788448480.507431:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448480.507581:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+14:2398:x1875323801148800:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 7330us (8366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448480.507595:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:0.0:1788448480.507661:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:2399:x1875323801148928:12345-192.168.206.21@tcp:4:lhsmtool_posix.0 Request processed in 2584us (3203us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788448480.507675:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00002000:00100000:0.0:1788448480.507687:0:8438:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9fc08368bb80 x1875323801148928/t4294967321(0) o4->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:716/0 lens 504/448 e 0 to 0 dl 1788448491 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448480.507698:0:8438:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc08368bb80 with x1875323801148928 ext(0->12) 00002000:00010000:0.0:1788448480.507704:0:8438:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc08368bb80 00000100:00100000:2.0:1788448480.512117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.513336:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801149056 00000100:00100000:3.0:1788448480.513356:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801149056 00000100:00100000:2.0:1788448480.513604:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:2.0:1788448480.513617:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+73:12466:x1875323801149056:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788448480.527954:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788448480.528010:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788448480.528038:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc083d2a180 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788448480.528044:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083d2a780 00000020:00080000:3.0:1788448480.528047:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc1a03ab000 00000004:00080000:3.0:1788448480.528094:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1788448480.528130:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc083d2acc0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788448480.528134:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083d2a840 00000020:00080000:3.0:1788448480.528137:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083efe200 00000020:00080000:3.0:1788448480.528148:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1788448480.528441:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826367616:0@lo:6:osp-syn-1-0.0 00000020:00080000:1.0:1788448480.528539:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1788448480.528550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788448480.528652:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788448480.528678:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826367616 00000100:00100000:1.0:1788448480.528691:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826367616 00000100:00100000:1.0:1788448480.528768:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00010000:00010000:2.0:1788448480.528772:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.528786:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3648:x1875323826367616:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788448480.528794:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.528828:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.528835:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.528841:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.528851:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.528908:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9fc08319c200) 00010000:00010000:2.0:1788448480.528912:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.528919:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.528925:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804413 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13810 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788448480.529004:0:8434:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:2.0:1788448480.529033:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448480.529041:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a998edf, atime: 0x6a998edf, ctime: 0x6a998edf, blocks: 0x8 00010000:00010000:2.0:1788448480.529044:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.529053:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529055:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529097:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.529105:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.529112:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:1.0:1788448480.529119:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448480.529134:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529139:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.529163:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826367744:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788448480.529173:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9fc1bb42c500) 00010000:00010000:2.0:1788448480.529178:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448480.529179:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529183:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529212:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b8044bb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.529222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448480.529226:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529244:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.529245:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529277:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529285:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529309:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.529317:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529326:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.529333:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448480.529337:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:2.0:1788448480.529342:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.529345:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529364:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b804539 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529381:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529388:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529396:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529401:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.529404:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529411:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529420:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc1bb42c300) 00010000:00010000:2.0:1788448480.529422:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.529424:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529430:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1ec00/0xf45a9e4e6b80455c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529445:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529451:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529461:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529466:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.529469:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529475:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529483:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.529486:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.529489:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529496:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330a00/0xf45a9e4e6b80462e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529508:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529515:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529522:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529528:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fda00 already unused, calling callback (ffffffffc17794f0) 00000100:00100000:0.0:1788448480.529529:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826367744 00010000:00010000:2.0:1788448480.529532:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.529539:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826367744 00010000:00010000:2.0:1788448480.529549:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529560:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:2.0:1788448480.529562:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788448480.529565:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.529571:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b8046eb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.529634:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788448480.529646:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826367744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788448480.529673:0:8431:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:0.0:1788448480.529704:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.529727:0:8431:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.529736:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788448480.529741:0:8431:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448480.529754:0:8431:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.529787:0:8431:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 12 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.529803:0:8431:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 12 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.529818:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875323826367872:192.168.206.21@tcp:104: 00000004:00080000:3.0:1788448480.530013:0:3648:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083ff2d80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788448480.530025:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826367616:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788448480.530709:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448480.530744:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12466:x1875323801149056:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 17124us (18637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448480.530757:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 244 00010000:00010000:0.0:1788448480.531997:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448480.532014:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.532031:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448480.532037:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.532050:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.532078:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.532097:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034253748/0xf45a9e4e6b804715 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.532149:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448480.532151:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448480.532153:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448480.536670:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8431:1875323826367872:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448480.536713:0:8431:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.536955:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3648:x1875323826367616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8167us (8397us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788448480.536971:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788448480.537241:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448480.537459:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801149184 00000100:00100000:3.0:1788448480.537469:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801149184 00000100:00100000:3.0:1788448480.537535:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:3.0:1788448480.537548:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+13:2399:x1875323801149184:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788448480.540359:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788448480.540359:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000001:00080000:3.0:1788448480.540386:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000100:00100000:0.0:1788448480.540468:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801149312 00000100:00100000:0.0:1788448480.540480:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801149312 00010000:00010000:0.0:1788448480.540531:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 9 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.540580:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:0.0:1788448480.540590:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801149312:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.540606:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.540613:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 9 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.540629:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 9 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.540656:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2399:x1875323801149184:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 3109us (3416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.540666:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00010000:00010000:0.0:1788448480.540726:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b8044c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e08af expref: 8 pid: 8431 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.540778:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448480.540784:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448480.540792:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.540803:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.540849:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.540907:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801149312:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 318us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.540915:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 105 00010000:00010000:1.0:1788448480.540992:0:8431:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.541003:0:8431:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.541014:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.541023:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.541049:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788448480.541249:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826367744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11604us (12032us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788448480.541257:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788448480.541312:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:1.0:1788448480.541320:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083f78380, transno 4294967316 00000004:00080000:1.0:1788448480.541343:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:1.0:1788448480.541371:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc083ff1880 x1875323826367744/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788448496 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788448480.541384:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083ff1880/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788448480.541390:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826367744:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788448480.541800:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448480.541810:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.541820:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448480.541825:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.541836:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.541854:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.541875:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a2d3f45/0xf45a9e4e6b80471c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.541924:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448480.541926:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448480.541928:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448480.546753:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.547042:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801149568 00000100:00100000:1.0:1788448480.547056:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801149568 00000100:00100000:1.0:1788448480.547143:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:1.0:1788448480.547156:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12466:x1875323801149568:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448480.547231:0:6517:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448480.547266:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804700 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0949 expref: 21 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.547292:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:1.0:1788448480.547299:0:6517:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448480.547344:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.547362:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.547373:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448480.547532:0:6517:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000096e8a369 reply state 000000006c36544e transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.547547:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.547576:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:1.0:1788448480.547579:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448480.547583:0:6517:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448480.548249:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:12466:x1875323801149568:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1090us (1504us total) trans 4294967509 rc 0/0 00000100:00100000:1.0:1788448480.548259:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 245 00000100:00100000:3.0:1788448480.551726:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.559215:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801149696 00000100:00100000:1.0:1788448480.559239:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801149696 00000100:00100000:1.0:1788448480.559404:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:1.0:1788448480.559417:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2399:x1875323801149696:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788448480.559628:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788448480.559633:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788448479 00002000:00010000:1.0:1788448480.559635:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788448479 00002000:00010000:1.0:1788448480.559638:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788448480 -> 1788448479 00002000:00010000:1.0:1788448480.559641:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788448480.559750:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2399:x1875323801149696:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 335us (8038us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788448480.559759:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1788448480.562483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.563421:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801149952 00000100:00100000:0.0:1788448480.563450:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801149952 00000100:00100000:0.0:1788448480.563525:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 246 00000100:00100000:0.0:1788448480.563538:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:12466:x1875323801149952:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788448480.563630:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.563649:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 22 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.563661:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.563703:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 22 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.563719:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 22 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.563736:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875323826368000:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448480.565793:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448480.569856:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6518:1875323826368000:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448480.569933:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448480.570390:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.570479:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150080 00000100:00100000:1.0:1788448480.570488:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150080 00010000:00010000:1.0:1788448480.570536:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 23 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.570580:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:1.0:1788448480.570592:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+23:2398:x1875323801150080:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448480.570611:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448480.570636:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 23 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.570650:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 23 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.570677:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152ec00/0xf45a9e4e6b8046e4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e093b expref: 23 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.570697:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:1.0:1788448480.570702:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.570713:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.570721:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.570752:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448480.570836:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:2398:x1875323801150080:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 245us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.570844:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 106 00010000:00010000:0.0:1788448480.571156:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571164:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571209:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571217:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571224:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571230:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448480.571234:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571241:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571251:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:0.0:1788448480.571254:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788448480.571258:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.571276:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b80472a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.571332:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12466:x1875323801149952:12345-192.168.206.21@tcp:55:lhsmtool_posix.0 Request processed in 7796us (8862us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788448480.571340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 246 00000100:00100000:0.0:1788448480.574547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.574620:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150208 00000100:00100000:1.0:1788448480.574631:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150208 00000100:00100000:1.0:1788448480.574697:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:1.0:1788448480.574709:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2400:x1875323801150208:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788448480.574765:0:8539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.574808:0:8539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.574817:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448480.574821:0:8539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448480.574826:0:8539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.574873:0:8539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 8 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.574943:0:8539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 8 pid: 8539 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.574969:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826368128:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448480.575061:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448480.578045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.578197:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150336 00000100:00100000:0.0:1788448480.578210:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150336 00010000:00010000:0.0:1788448480.578264:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 9 pid: 8539 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.578301:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:0.0:1788448480.578313:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801150336:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.578330:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.578357:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 9 pid: 8539 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.578373:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 9 pid: 8539 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.578401:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448480.578407:0:6502:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448480.578414:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.578445:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.578468:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.578540:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+9:2398:x1875323801150336:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 228us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.578547:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 107 00010000:00010000:1.0:1788448480.579021:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b80470e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0957 expref: 8 pid: 8539 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.579042:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8539:1875323826368128:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448480.579092:0:8539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579104:0:8539:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579119:0:8539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579143:0:8539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579153:0:8539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579162:0:8539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579170:0:8539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448480.579174:0:8539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579184:0:8539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579198:0:8539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.579206:0:8539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804731 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.579277:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2400:x1875323801150208:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 4570us (4743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.579287:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:2.0:1788448480.582230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.582320:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150592 00000100:00100000:1.0:1788448480.582331:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150592 00000100:00100000:1.0:1788448480.582392:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:1.0:1788448480.582403:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:12466:x1875323801150592:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788448480.582495:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.582514:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.582526:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.582565:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.582579:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 21 pid: 6517 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.582595:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826368256:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448480.582684:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448480.585370:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.585462:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150720 00000100:00100000:0.0:1788448480.585474:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150720 00010000:00010000:0.0:1788448480.585523:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 22 pid: 6517 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.585570:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:0.0:1788448480.585581:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:2398:x1875323801150720:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.585598:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.585607:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 22 pid: 6517 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.585621:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 22 pid: 6517 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.585648:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.585655:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.585687:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.585696:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.585703:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.585724:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.585805:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:2398:x1875323801150720:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 225us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.585814:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 108 00010000:00010000:1.0:1788448480.586972:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804627 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0903 expref: 21 pid: 6517 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.587014:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826368256:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448480.587047:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587057:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587063:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587272:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587297:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587306:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587342:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.587359:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 21 pid: 6518 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448480.587374:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826368384:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448480.587463:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448480.593849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.594133:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826368384:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448480.594184:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.594270:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150848 00000100:00100000:0.0:1788448480.594292:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150848 00010000:00010000:0.0:1788448480.594344:0:6502:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 22 pid: 6518 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.594381:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:0.0:1788448480.594392:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:2398:x1875323801150848:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.594412:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.594421:0:6502:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 22 pid: 6518 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.594436:0:6502:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 22 pid: 6518 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.594488:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b8046f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0942 expref: 22 pid: 6518 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.594506:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:0.0:1788448480.594511:0:6502:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.594522:0:6502:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.594530:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.594562:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.594636:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:2398:x1875323801150848:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 245us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.594645:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 109 00010000:00010000:1.0:1788448480.594758:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.594766:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448480.594945:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1788448480.595110:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1788448480.595151:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1788448480.595245:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1875323826368512:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788448480.595325:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448480.595359:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc182d57f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448480.596682:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826368512 00000100:00100000:0.0:1788448480.596697:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826368512 00000100:00100000:0.0:1788448480.596767:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788448480.596778:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875323826368512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448480.596928:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875323826368512:12345-0@lo:1000:mdt00_002.0 Request processed in 151us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.596937:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788448480.597219:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1875323826368512:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788448480.597403:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788448480.597478:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1875323826368640:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788448480.597520:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448480.597549:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448480.597591:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826368640 00000100:00100000:0.0:1788448480.597595:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826368640 00000100:00100000:0.0:1788448480.597625:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788448480.597632:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1875323826368640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448480.597765:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1875323826368640:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (244us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788448480.597773:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788448480.598022:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6519:1875323826368640:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788448480.598065:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598094:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598103:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598110:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.598115:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598124:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598144:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:2.0:1788448480.598147:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448480.598153:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598160:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc600/0xf45a9e4e6b80473f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598191:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598198:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598204:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598209:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.598219:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598226:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598237:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.598239:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448480.598246:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598257:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598266:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.598292:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448480.598304:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826368768:192.168.206.21@tcp:105: 00000100:00100000:2.0:1788448480.598370:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083d2a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448480.601638:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.601746:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6519:1875323826368768:192.168.206.21@tcp:105: 00010000:00010000:2.0:1788448480.601781:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601792:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804682 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601853:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601869:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601923:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601936:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601943:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601949:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601955:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.601959:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601977:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.601990:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.601993:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448480.601996:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602002:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330400/0xf45a9e4e6b804746 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602019:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602025:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602035:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602041:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448480.602044:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602050:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602058:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448480.602061:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448480.602063:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.602069:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804738 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448480.602263:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:12466:x1875323801150592:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 19860us (20045us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788448480.602274:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 247 00000040:00080000:0.0:1788448480.602483:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448480.602488:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448480.602982:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788448480.602994:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:00080000:2.0:1788448480.603329:0:6519:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788448480.603582:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801150976 00000100:00100000:1.0:1788448480.603593:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801150976 00000100:00100000:1.0:1788448480.603650:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:1.0:1788448480.603662:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:12465:x1875323801150976:12345-192.168.206.21@tcp:49:lfs.0 00000100:00100000:1.0:1788448480.603804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:12465:x1875323801150976:12345-192.168.206.21@tcp:49:lfs.0 Request processed in 143us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.603812:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:3.0:1788448480.606734:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448480.606839:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801151232 00000100:00100000:1.0:1788448480.606851:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801151232 00000100:00100000:3.0:1788448480.607713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.608002:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:2.0:1788448480.608021:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b9a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+24:12466:x1875323801151232:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448480.608423:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801151488 00000100:00100000:0.0:1788448480.608431:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801151488 00000004:00080000:2.0:1788448480.608513:0:6521:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788448480.608550:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00000100:00100000:0.0:1788448480.608585:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 248 00010000:00010000:2.0:1788448480.608590:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.608597:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12465:x1875323801151488:12345-192.168.206.21@tcp:58:lfs.0 00010000:00010000:2.0:1788448480.608613:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.608629:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.608639:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.608646:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.608654:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448480.608690:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000040:00080000:0.0:1788448480.608725:0:9023:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788448480.608816:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12465:x1875323801151488:12345-192.168.206.21@tcp:58:lfs.0 Request processed in 223us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.608825:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 248 00010000:00010000:3.0:1788448480.608974:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448480.608982:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.608991:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331a00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448480.608996:0:9522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.609005:0:9522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.609020:0:9522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:3.0:1788448480.609024:0:9522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788448480.609029:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.609046:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331a00/0xf45a9e4e6b80474d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448480.609061:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448480.609063:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448480.609065:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448480.609604:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b9a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+26:12466:x1875323801151232:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 1587us (2882us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788448480.609615:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000020:00080000:2.0:1788448480.609621:0:6521:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788448480.638099:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.638233:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801151616 00000100:00100000:0.0:1788448480.638247:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801151616 00000100:00100000:0.0:1788448480.638343:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 249 00000100:00100000:0.0:1788448480.638357:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+26:12468:x1875323801151616:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448480.638390:0:13811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448480.638417:0:13811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804754 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e095e expref: -99 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638501:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638519:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638549:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638569:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638576:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638583:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638680:0:13811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638692:0:13811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 27 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638702:0:13811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638743:0:13811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 27 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.638759:0:13811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 27 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.638776:0:13811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826368896:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448480.638963:0:13811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448480.642216:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448480.642428:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801151872 00000100:00100000:2.0:1788448480.642439:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801151872 00000100:00100000:2.0:1788448480.642508:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:2.0:1788448480.642519:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+28:6168:x1875323801151872:12345-192.168.206.21@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788448480.642965:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:6168:x1875323801151872:12345-192.168.206.21@tcp:35:ldlm_bl.0 Request processed in 436us (754us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788448480.642989:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:0.0:1788448480.643776:0:13811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0700 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13811:1875323826368896:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448480.644070:0:13811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448480.646685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448480.646808:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801152000 00000100:00100000:0.0:1788448480.646820:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801152000 00010000:00010000:0.0:1788448480.646872:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 29 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448480.646945:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:0.0:1788448480.646966:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:2398:x1875323801152000:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448480.646985:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448480.646993:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 29 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.647008:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 29 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.647034:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f800/0xf45a9e4e6b804674 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e091f expref: 29 pid: 13810 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.647057:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448480.647062:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.647073:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.647092:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448480.647353:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448480.647427:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+28:2398:x1875323801152000:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 471us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.647436:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 110 00010000:00010000:1.0:1788448480.651407:0:13811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651429:0:13811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448480.651520:0:13811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788448480.651525:0:13811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448480.651548:0:13811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651566:0:13811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651577:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651584:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651592:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651598:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448480.651603:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651611:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651628:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448480.651631:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448480.651636:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651643:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f600/0xf45a9e4e6b80475b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651672:0:13811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651679:0:13811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651685:0:13811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651689:0:13811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448480.651692:0:13811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651697:0:13811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651704:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9fc08336b700) 00010000:00010000:1.0:1788448480.651706:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448480.651708:0:13811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651713:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e000/0xf45a9e4e6b804762 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651756:0:13811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e800/0xf45a9e4e6b804754 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e095e expref: 28 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651770:0:13811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e095e expref: 27 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448480.651800:0:13811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448480.651803:0:13811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448480.651806:0:13811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:1.0:1788448480.651916:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12468:x1875323801151616:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 13562us (13841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.651926:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 249 00000100:00100000:0.0:1788448480.958398:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448480.958427:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826369024:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448480.958520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448480.958603:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369024 00000100:00100000:0.0:1788448480.958613:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369024 00000100:00100000:0.0:1788448480.958667:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788448480.958677:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826369024:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448480.958719:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788448480.958788:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826369024:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448480.958796:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788448480.958869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826369024:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448481.279877:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788448481.345348:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788448481.345362:0:9511:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:1.0:1788448481.357271:0:14711:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448481.357278:0:14711:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448481.357308:0:14711:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788448481.357313:0:14711:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788448481.662095:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448481.662104:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448481.662131:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788448481.662141:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448481.662283:0:13801:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826369152:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448481.662377:0:13801:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448481.666013:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448481.666790:0:13801:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff3b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13801:1875323826369152:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448481.667227:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801152128 00000100:00100000:2.0:1788448481.667234:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801152128 00000100:00100000:2.0:1788448481.667301:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 250 00000100:00100000:2.0:1788448481.667311:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12480:x1875323801152128:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448481.667345:0:13810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:3.0:1788448481.667354:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448481.667450:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12480:x1875323801152128:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 140us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448481.667458:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 250 00000100:00100000:3.0:1788448481.672063:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448481.678188:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801152384 00000100:00100000:1.0:1788448481.678204:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801152384 00000100:00100000:1.0:1788448481.678277:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:1.0:1788448481.678287:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+27:12480:x1875323801152384:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448481.678306:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448481.678373:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804770 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0965 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448481.678504:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804777 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448481.678519:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448481.678532:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804777 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448481.678560:0:6517:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788448481.678659:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b804770 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0965 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448481.678678:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804777 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0965 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448481.678687:0:6517:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448481.678690:0:6517:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448481.678693:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd400, rc 0) 00000100:00100000:1.0:1788448481.679174:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:12480:x1875323801152384:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 886us (7118us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788448481.679182:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:3.0:1788448481.695021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448481.695054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448481.695272:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801152768 00000100:00100000:2.0:1788448481.695282:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801152768 00000100:00100000:2.0:1788448481.695338:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:2.0:1788448481.695348:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:12480:x1875323801152768:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788448481.695422:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695437:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695449:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695594:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695618:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695625:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695631:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448481.695636:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695643:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695656:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448481.695659:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448481.695663:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448481.695669:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330200/0xf45a9e4e6b804785 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448481.695791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:12480:x1875323801152768:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 443us (734us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788448481.695799:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 252 00000040:00080000:3.0:1788448481.696290:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448481.696295:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448481.696777:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788448481.696786:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448481.697129:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801152512 00000100:00100000:0.0:1788448481.697137:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801152512 00000100:00100000:0.0:1788448481.697192:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1788448481.697201:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:2399:x1875323801152512:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448481.697226:0:6502:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448481.697246:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804777 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0965 expref: 30 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448481.697261:0:6502:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:0.0:1788448481.697265:0:6502:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448481.697327:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:2399:x1875323801152512:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 127us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448481.697335:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1788448481.703306:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448481.703394:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153024 00000100:00100000:2.0:1788448481.703405:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153024 00000100:00100000:2.0:1788448481.703462:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:2.0:1788448481.703473:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+29:12480:x1875323801153024:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448481.703675:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:12480:x1875323801153024:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 203us (380us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788448481.703695:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00010000:00010000:0.0:1788448482.302101:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448483.008012:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448483.008033:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826369280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448483.008113:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448483.008179:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369280 00000100:00100000:1.0:1788448483.008186:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369280 00000100:00100000:1.0:1788448483.008235:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788448483.008245:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826369280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448483.008271:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788448483.008309:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826369280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448483.008315:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788448483.008334:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448483.008379:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826369280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448483.008648:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448483.008658:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826369408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448483.010534:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788448483.014537:0:8537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 400359653246ns, next at 401359650641ns, rc = 0 00000100:00100000:1.0:1788448483.014561:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448483.014581:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826369536:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448483.014645:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448483.014697:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369536 00000100:00100000:1.0:1788448483.014704:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369536 00000100:00100000:1.0:1788448483.014767:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788448483.014777:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826369536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448483.014798:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788448483.014837:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875323826369536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448483.014844:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1788448483.014865:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448483.014920:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826369536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448483.019007:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369408 00000100:00100000:0.0:1788448483.019022:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369408 00000100:00100000:0.0:1788448483.019090:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788448483.019101:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826369408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448483.019137:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448483.019217:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826369408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (8690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448483.019224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788448483.019288:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826369408:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788448483.336826:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448483.337447:0:14762:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448483.337453:0:14762:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448483.337485:0:14762:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788448483.337492:0:14762:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788448483.581569:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448483.581623:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153280 00000100:00100000:2.0:1788448483.581638:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153280 00000100:00100000:2.0:1788448483.581718:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:2.0:1788448483.581728:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+30:12501:x1875323801153280:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448483.581751:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788448483.581770:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448483.581772:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b80478c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e096c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448483.581913:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804793 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448483.581929:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804793 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448483.581941:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804793 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448483.581952:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788448483.582090:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b80478c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e096c expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448483.582108:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804793 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e096c expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448483.582116:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:2.0:1788448483.582124:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788448483.582141:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331800, rc 0) 00000100:00100000:2.0:1788448483.582207:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:12501:x1875323801153280:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 480us (648us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788448483.582223:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:0.0:1788448483.586385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448483.586494:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153408 00000100:00100000:1.0:1788448483.586505:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153408 00000100:00100000:1.0:1788448483.586560:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:1.0:1788448483.586571:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:12501:x1875323801153408:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1788448483.586641:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586658:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586670:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586709:0:9023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586732:0:9023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586738:0:9023:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586743:0:9023:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448483.586748:0:9023:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586755:0:9023:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586768:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448483.586771:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448483.586776:0:9023:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.586782:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc000/0xf45a9e4e6b8047a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448483.586853:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:12501:x1875323801153408:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 283us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448483.586861:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:3.0:1788448483.709034:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448483.709527:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153536 00000100:00100000:1.0:1788448483.709609:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153536 00000100:00100000:1.0:1788448483.709682:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:1.0:1788448483.709692:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801153536:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:1.0:1788448483.709709:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788448483.709818:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448483.710276:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b8047a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0973 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448483.710301:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a998edf, atime: 0x6a998edf, ctime: 0x6a998edf, blocks: 0x8 00010000:00010000:1.0:1788448483.710319:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1788448483.710324:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448483.710333:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b8047a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0973 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.710352:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b8047a8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0973 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448483.710364:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc000, rc 0) 00000100:00100000:1.0:1788448483.710866:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2401:x1875323801153536:12345-192.168.206.21@tcp:101:cat.0 Request processed in 1172us (1840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448483.710875:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:3.0:1788448483.720831:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448483.724900:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153664 00000100:00100000:0.0:1788448483.724917:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153664 00002000:00100000:0.0:1788448483.724973:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9fc0834f4380 x1875323801153664/t0(0) o3->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:719/0 lens 488/0 e 0 to 0 dl 1788448494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448483.724999:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc0834f4380 with x1875323801153664 ext(0->4095) 00002000:00010000:0.0:1788448483.725006:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc0834f4380 00000100:00100000:0.0:1788448483.725047:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448483.725058:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2401:x1875323801153664:12345-192.168.206.21@tcp:3:cat.0 00000100:00100000:0.0:1788448483.725244:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2401:x1875323801153664:12345-192.168.206.21@tcp:3:cat.0 Request processed in 188us (4423us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788448483.725251:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00002000:00100000:0.0:1788448483.725258:0:8437:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9fc0834f4380 x1875323801153664/t0(0) o3->5f39813a-d0bd-49ee-95eb-2130028b48f0@192.168.206.21@tcp:719/0 lens 488/4536 e 0 to 0 dl 1788448494 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448483.725265:0:8437:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9fc0834f4380 with x1875323801153664 ext(0->4095) 00002000:00010000:0.0:1788448483.725268:0:8437:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9fc0834f4380 00010000:00010000:3.0:1788448484.350125:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448485.054173:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826369920:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054260:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448485.054306:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826370432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054331:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448485.054352:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826370944:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054370:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448485.054396:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788448485.054402:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826369792:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054422:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448485.054438:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826370304:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054456:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448485.054482:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826370816:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054507:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448485.054536:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370432 00000100:00100000:3.0:1788448485.054543:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370432 00000100:00100000:3.0:1788448485.054608:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370944 00000100:00100000:3.0:1788448485.054611:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370944 00000100:00100000:3.0:1788448485.054625:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369792 00000100:00100000:3.0:1788448485.054627:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369792 00000100:00100000:3.0:1788448485.054636:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370304 00000100:00100000:3.0:1788448485.054638:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370304 00000100:00100000:3.0:1788448485.054649:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370816 00000100:00100000:3.0:1788448485.054651:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370816 00000100:00100000:3.0:1788448485.054666:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788448485.054674:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826370432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054723:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826370432:12345-0@lo:400:kworker.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448485.054744:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788448485.054762:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788448485.054768:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826370944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.054798:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826370944:12345-0@lo:400:kworker.0 Request processed in 31us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448485.054804:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788448485.054925:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826370048:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.054975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.054994:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826370560:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.055032:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.055049:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826371072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.055083:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.055101:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788448485.055108:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826369664:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.055134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.055152:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826370176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.055173:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.055187:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826370688:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.055206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.055223:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826371200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.055242:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448485.055269:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370048 00000100:00100000:2.0:1788448485.055272:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370048 00000100:00100000:0.0:1788448485.055352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369920 00000100:00100000:0.0:1788448485.055356:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369920 00000100:00100000:0.0:1788448485.055377:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370176 00000100:00100000:0.0:1788448485.055379:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370176 00000100:00100000:0.0:1788448485.055391:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788448485.055398:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826369920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.055435:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826369920:12345-0@lo:400:kworker.0 Request processed in 37us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448485.055441:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1788448485.055456:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788448485.055462:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826370176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.055493:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826370176:12345-0@lo:400:kworker.0 Request processed in 32us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448485.055509:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1788448485.055578:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370560 00000100:00100000:1.0:1788448485.055582:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370560 00000100:00100000:1.0:1788448485.055604:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371072 00000100:00100000:1.0:1788448485.055607:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371072 00000100:00100000:1.0:1788448485.055619:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826370688 00000100:00100000:1.0:1788448485.055621:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826370688 00000100:00100000:1.0:1788448485.055630:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371200 00000100:00100000:1.0:1788448485.055633:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371200 00000100:00100000:1.0:1788448485.055646:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788448485.055652:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826370560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448485.055688:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826370560:12345-0@lo:400:kworker.0 Request processed in 36us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.055703:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788448485.055716:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448485.055722:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826371072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448485.055751:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826371072:12345-0@lo:400:kworker.0 Request processed in 30us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.055757:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448485.055767:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788448485.055773:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826370688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448485.055798:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3645:x1875323826370688:12345-0@lo:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.055803:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788448485.055828:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788448485.055835:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826371200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448485.055862:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826371200:12345-0@lo:400:kworker.0 Request processed in 28us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.055868:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788448485.056403:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788448485.056414:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826369792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.056450:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826369792:12345-0@lo:400:kworker.0 Request processed in 39us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.056481:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:2.0:1788448485.056496:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788448485.056503:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826370304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.056531:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826370304:12345-0@lo:400:kworker.0 Request processed in 29us (2074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.056536:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1788448485.056546:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788448485.056552:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826370816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.056576:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826370816:12345-0@lo:400:kworker.0 Request processed in 25us (2069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.056581:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788448485.056592:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788448485.056598:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826370048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448485.056622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826370048:12345-0@lo:400:kworker.0 Request processed in 26us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.056628:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788448485.056848:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826369664 00000100:00100000:0.0:1788448485.056855:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826369664 00000100:00100000:0.0:1788448485.056914:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788448485.056922:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826369664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.056965:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826369664:12345-0@lo:400:kworker.0 Request processed in 44us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448485.056971:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788448485.057020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826369664:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.057036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826370176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.057047:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826370688:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.057068:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788448485.057073:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:0.0:1788448485.057109:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083f7a680, transno 4294967308 00000004:00080000:0.0:1788448485.057129:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1788448485.057140:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083ff2d80, transno 4294967311 00000100:00100000:0.0:1788448485.057146:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826371200:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.057160:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826370048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.057171:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826370560:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.057180:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826371072:0@lo:400:kworker.0 00000100:00080000:3.0:1788448485.057729:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448485.057736:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448485.057738:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448485.057741:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448485.057768:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826369792:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.057778:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826370304:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.057787:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826370816:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.057797:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826369920:0@lo:400:kworker.0 00010000:00080000:3.0:1788448485.057819:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f4e00 x1875323826370432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448485.057830:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826370432:0@lo:400:kworker.0 00010000:00080000:3.0:1788448485.057840:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f5180 x1875323826370944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448501 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448485.057849:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826370944:0@lo:400:kworker.0 00000100:00100000:0.0:1788448485.225342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448485.225393:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448485.225453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448485.225483:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448485.225522:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153792 00000100:00100000:2.0:1788448485.225531:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153792 00000100:00100000:2.0:1788448485.225583:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 394 00000100:00100000:2.0:1788448485.225594:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801153792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448485.225667:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2401:x1875323801153792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.225675:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 394 00000100:00100000:2.0:1788448485.226360:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154304 00000100:00100000:2.0:1788448485.226376:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154304 00000100:00100000:2.0:1788448485.226425:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:2.0:1788448485.226433:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801154304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448485.226477:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801154304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.226483:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00080000:2.0:1788448485.226534:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448485.229083:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448485.229202:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154048 00000100:00100000:3.0:1788448485.229211:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154048 00000100:00100000:1.0:1788448485.234411:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448485.234455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448485.234486:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154560 00000100:00100000:1.0:1788448485.234496:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154560 00000100:00100000:1.0:1788448485.234552:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801153920 00000100:00100000:1.0:1788448485.234555:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801153920 00000100:00100000:1.0:1788448485.234573:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154432 00000100:00100000:1.0:1788448485.234576:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154432 00000100:00100000:1.0:1788448485.234594:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 352 00000100:00100000:1.0:1788448485.234604:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801154560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448485.234697:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801154560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (9211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.234705:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 352 00000100:00100000:1.0:1788448485.234723:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 353 00000100:00100000:1.0:1788448485.234729:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:2401:x1875323801153920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448485.234754:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+32:2401:x1875323801153920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (5679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.234760:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 353 00000100:00100000:1.0:1788448485.234771:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 354 00000100:00100000:1.0:1788448485.234778:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801154432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448485.234799:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2401:x1875323801154432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.234805:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 354 00000100:00100000:0.0:1788448485.234858:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154176 00000100:00100000:0.0:1788448485.234862:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154176 00000100:00100000:0.0:1788448485.234931:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00100000:0.0:1788448485.234939:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2401:x1875323801154176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448485.234967:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5f39813a-d0bd-49ee-95eb-2130028b48f0+8:2401:x1875323801154176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448485.234973:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 166 00000100:00080000:2.0:1788448485.235096:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448485.235101:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448485.235104:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448485.235320:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 355 00000100:00100000:2.0:1788448485.235329:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801154048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448485.235366:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2401:x1875323801154048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (9972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448485.235373:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 355 00000100:00080000:0.0:1788448485.240001:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788448485.375474:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448485.566414:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826371328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448485.566545:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448485.566722:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371328 00000100:00100000:1.0:1788448485.566729:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371328 00000100:00100000:1.0:1788448485.566788:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788448485.566798:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826371328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448485.566825:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788448485.566875:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826371328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448485.566901:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788448485.566944:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826371328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448485.567642:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826371456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448485.567696:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448485.567904:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371456 00000100:00100000:0.0:1788448485.567909:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371456 00000100:00100000:0.0:1788448485.567939:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788448485.567947:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826371456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448485.567967:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788448485.568001:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826371456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448485.568008:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788448485.568088:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826371456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448486.079015:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448486.079100:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826371584:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448486.079177:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448486.079499:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371584 00000100:00100000:3.0:1788448486.079507:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371584 00000100:00100000:3.0:1788448486.079565:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788448486.079577:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826371584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448486.079609:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788448486.079667:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826371584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448486.079675:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788448486.079757:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826371584:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788448486.401605:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448486.527046:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:1.0:1788448486.593235:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000004:00080000:1.0:1788448486.593248:0:6496:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1788448486.593279:0:6496:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9fc083d2a480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788448486.593284:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083d2a240 00000020:00080000:1.0:1788448486.593287:0:6496:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9fc083d58d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9fc083e27000 00000020:00080000:2.0:1788448486.593343:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:2.0:1788448486.593417:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788448486.593548:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:3.0:1788448486.594552:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448486.594567:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448486.594575:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448486.594580:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fce00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448486.594585:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448486.594593:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448486.594611:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9fc1bb42c200) 00010000:00010000:3.0:1788448486.594614:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448486.594618:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448486.594639:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fce00/0xf45a9e4e6b804723 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6517 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448486.595281:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448486.595301:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826371712:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788448486.595383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:0.0:1788448486.596248:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1788448486.596258:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000100:00100000:2.0:1788448486.600877:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371712 00000100:00100000:2.0:1788448486.600957:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371712 00000100:00100000:2.0:1788448486.601091:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788448486.601102:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826371712:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788448486.601250:0:8539:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788448486.601267:0:8539:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788448479 -> 1788448479 00002000:00010000:2.0:1788448486.601269:0:8539:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 1788448479 -> 1788448479 00002000:00010000:2.0:1788448486.601272:0:8539:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788448479 -> 1788448479 00002000:00010000:2.0:1788448486.601274:0:8539:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788448486.601540:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826371712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 440us (6156us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788448486.601549:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788448486.601633:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788448486.601639:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083ff1880, transno 4294967322 00000004:00080000:1.0:1788448486.601658:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1788448486.601681:0:3645:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9fc083ff1c00 x1875323826371712/t4294967325(4294967325) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788448502 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788448486.601692:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc083ff1c00/2, rc 0, transno 4294967325 00000100:00100000:1.0:1788448486.601697:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826371712:0@lo:2:osp-syn-0-0.0 00000040:00080000:3.0:1788448486.850017:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448486.850026:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448486.850066:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788448486.850073:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788448487.422123:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448488.126033:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826371840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448488.126108:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448488.126179:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371840 00000100:00100000:0.0:1788448488.126187:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371840 00000100:00100000:0.0:1788448488.126228:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788448488.126237:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826371840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448488.126278:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448488.126322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826371840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448488.126329:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788448488.126373:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826371840:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448488.139094:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0825c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826371968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448488.139164:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448488.139289:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826371968 00000100:00100000:2.0:1788448488.139298:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826371968 00000100:00100000:2.0:1788448488.139361:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788448488.139371:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826371968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448488.139400:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788448488.139442:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826371968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448488.139449:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:1.0:1788448488.139495:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448488.139534:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0825c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826371968:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448488.141843:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826372096:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448488.141927:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448488.142192:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372096 00000100:00100000:0.0:1788448488.142199:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372096 00000100:00100000:0.0:1788448488.142260:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448488.142271:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826372096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448488.142293:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788448488.142344:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826372096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448488.142351:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448488.142392:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826372096:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448488.142474:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448488.447150:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448489.073285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448489.073535:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154688 00000100:00100000:2.0:1788448489.073545:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154688 00000100:00100000:2.0:1788448489.073629:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:2.0:1788448489.073641:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:12154:x1875323801154688:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788448489.073750:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:12154:x1875323801154688:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 111us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448489.073759:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00080000:1.0:1788448489.074463:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448489.087383:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448489.087688:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801154816 00000100:00100000:1.0:1788448489.087698:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801154816 00000100:00100000:1.0:1788448489.087774:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 256 00000100:00100000:1.0:1788448489.087785:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:12154:x1875323801154816:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788448489.087918:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:12154:x1875323801154816:12345-192.168.206.21@tcp:60:lhsmtool_posix.0 Request processed in 134us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448489.087926:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 256 00000100:00080000:2.0:1788448489.087932:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448489.102508:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448489.102910:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155072 00000100:00100000:3.0:1788448489.102920:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155072 00000100:00100000:3.0:1788448489.102976:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:3.0:1788448489.102986:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:12154:x1875323801155072:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788448489.103223:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:12154:x1875323801155072:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 238us (724us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788448489.103231:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1788448489.393112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448489.393324:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155200 00000100:00100000:3.0:1788448489.393334:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155200 00000100:00100000:3.0:1788448489.393414:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00100000:3.0:1788448489.393425:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:12960:x1875323801155200:12345-192.168.206.21@tcp:101:lsof.0 00010000:00010000:3.0:1788448489.393443:0:9023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448489.393463:0:9023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b8047af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e097a expref: -99 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448489.393525:0:9023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b8047b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448489.393538:0:9023:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b8047b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448489.393565:0:9023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b8047b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448489.393611:0:9023:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448489.393615:0:9023:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448489.393634:0:9023:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b8047b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9023 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448489.393656:0:9023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f400/0xf45a9e4e6b8047af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e097a expref: 7 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448489.393673:0:9023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b8047b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e097a expref: 6 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448489.393682:0:9023:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:3.0:1788448489.393685:0:9023:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448489.393688:0:9023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f600, rc 0) 00000100:00100000:3.0:1788448489.393748:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:12960:x1875323801155200:12345-192.168.206.21@tcp:101:lsof.0 Request processed in 324us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448489.393755:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00080000:2.0:1788448489.393908:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448489.470090:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448490.176528:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826372608:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.176593:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.176644:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826372224:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.176652:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826373120:0@lo:400:kworker.0 00000100:00100000:2.0:1788448490.176677:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448490.176677:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.176699:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826372736:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.176699:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.176719:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.176720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.176747:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826373248:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.176754:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373120 00000100:00100000:0.0:1788448490.176760:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373120 00000100:00100000:2.0:1788448490.176767:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.176782:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826373760:0@lo:400:kworker.0 00000100:00100000:2.0:1788448490.176800:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448490.176803:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373632 00000100:00100000:0.0:1788448490.176820:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373632 00000100:00100000:2.0:1788448490.176821:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373248 00000100:00100000:2.0:1788448490.176823:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373248 00000100:00100000:2.0:1788448490.176837:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373760 00000100:00100000:2.0:1788448490.176839:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373760 00000100:00100000:0.0:1788448490.176840:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788448490.176848:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826373120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448490.176863:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788448490.176869:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826373248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.176915:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826373120:12345-0@lo:400:kworker.0 Request processed in 67us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.176916:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826373248:12345-0@lo:400:kworker.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.176923:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788448490.176968:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372608 00000100:00100000:3.0:1788448490.176973:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372608 00000100:00100000:1.0:1788448490.176981:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826372352:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177006:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788448490.177018:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.177022:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826372608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.177055:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826372864:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177075:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826372608:12345-0@lo:400:kworker.0 Request processed in 60us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.177083:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788448490.177087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.177107:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372352 00000100:00100000:1.0:1788448490.177111:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826373376:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177112:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372352 00000100:00100000:3.0:1788448490.177143:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372864 00000100:00100000:1.0:1788448490.177143:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.177147:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372864 00000100:00100000:3.0:1788448490.177166:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373376 00000100:00100000:3.0:1788448490.177169:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373376 00000100:00100000:1.0:1788448490.177174:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788448490.177184:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826372480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177190:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788448490.177199:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826372352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.177215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448490.177242:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826372992:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177247:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826372352:12345-0@lo:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.177255:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788448490.177272:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788448490.177275:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.177284:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826372864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.177292:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826373504:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177325:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826372864:12345-0@lo:400:kworker.0 Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448490.177332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.177339:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788448490.177353:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372992 00000100:00100000:3.0:1788448490.177356:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372992 00000100:00100000:3.0:1788448490.177372:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373504 00000100:00100000:3.0:1788448490.177374:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373504 00000100:00100000:3.0:1788448490.177386:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788448490.177392:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826373376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177419:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826373376:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.177425:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788448490.177437:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788448490.177443:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826372992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177468:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826372992:12345-0@lo:400:kworker.0 Request processed in 26us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.177481:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788448490.177493:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788448490.177499:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826373504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.177526:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826373504:12345-0@lo:400:kworker.0 Request processed in 28us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.177532:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788448490.177617:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826372352:0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.177628:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826372864:0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.177652:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186266300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826373376:0@lo:400:kworker.0 00010000:00080000:1.0:1788448490.177677:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf85a680 x1875323826372992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448490.177687:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826372992:0@lo:400:kworker.0 00010000:00080000:1.0:1788448490.177697:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc186267b80 x1875323826373504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448490.177704:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826373504:0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.178075:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372224 00000100:00100000:1.0:1788448490.178080:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372224 00000100:00100000:1.0:1788448490.178112:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788448490.178119:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826372224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.178153:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3646:x1875323826372224:12345-0@lo:400:kworker.0 Request processed in 35us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448490.178159:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788448490.178187:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372736 00000100:00100000:1.0:1788448490.178191:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372736 00000100:00100000:1.0:1788448490.178206:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826372480 00000100:00100000:1.0:1788448490.178208:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826372480 00000100:00100000:1.0:1788448490.178218:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788448490.178223:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826372736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.178252:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826372736:12345-0@lo:400:kworker.0 Request processed in 29us (1531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448490.178257:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788448490.178266:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788448490.178271:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826372480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.178307:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826372480:12345-0@lo:400:kworker.0 Request processed in 36us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448490.178313:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788448490.178338:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826372480:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179238:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788448490.179267:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788448490.179278:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179338:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826373632:12345-0@lo:400:kworker.0 Request processed in 63us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448490.179344:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788448490.179355:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788448490.179362:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826373760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179390:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826373760:12345-0@lo:400:kworker.0 Request processed in 28us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448490.179395:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788448490.179436:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf859f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826372608:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179448:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826373120:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179457:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826373632:0@lo:400:kworker.0 00000100:00080000:1.0:1788448490.179510:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448490.179516:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448490.179520:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448490.179522:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826372224:0@lo:400:kworker.0 00000100:00080000:1.0:1788448490.179524:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448490.179539:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826372736:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179552:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186265880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826373248:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.179562:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186266a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826373760:0@lo:400:kworker.0 00000100:00100000:2.0:1788448490.342572:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342697:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342748:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342763:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448490.342812:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155840 00000100:00100000:2.0:1788448490.342821:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155840 00000100:00100000:2.0:1788448490.342874:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155712 00000100:00100000:2.0:1788448490.342925:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155712 00000100:00100000:2.0:1788448490.342952:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:2.0:1788448490.342962:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801155840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448490.343192:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801155840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 230us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.343201:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 171 00000100:00100000:2.0:1788448490.343217:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 172 00000100:00100000:2.0:1788448490.343224:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801155712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448490.343250:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2398:x1875323801155712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.343256:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 172 00000100:00080000:1.0:1788448490.343546:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448490.343551:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448490.345143:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155584 00000100:00100000:3.0:1788448490.345156:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155584 00000100:00100000:3.0:1788448490.345206:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156096 00000100:00100000:3.0:1788448490.345209:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156096 00000100:00100000:3.0:1788448490.345244:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155456 00000100:00100000:3.0:1788448490.345248:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155456 00000100:00100000:3.0:1788448490.345261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155968 00000100:00100000:3.0:1788448490.345264:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155968 00000100:00100000:3.0:1788448490.345287:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 362 00000100:00100000:3.0:1788448490.345297:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801155584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448490.345361:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2398:x1875323801155584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (2694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.345629:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 362 00000100:00100000:3.0:1788448490.345648:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 363 00000100:00100000:3.0:1788448490.345655:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801156096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448490.345684:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2398:x1875323801156096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (2955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.345690:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 363 00000100:00100000:3.0:1788448490.345701:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 364 00000100:00100000:3.0:1788448490.345707:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:2398:x1875323801155456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448490.345750:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0825c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:2398:x1875323801155456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (3002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.345757:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 364 00000100:00100000:3.0:1788448490.345768:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 365 00000100:00100000:3.0:1788448490.345775:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2398:x1875323801155968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448490.345796:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2398:x1875323801155968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (3007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.345802:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 365 00000100:00080000:1.0:1788448490.346322:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448490.346465:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801155328 00000100:00100000:0.0:1788448490.346472:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801155328 00000100:00100000:0.0:1788448490.346523:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 396 00000100:00100000:0.0:1788448490.346532:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801155328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448490.346578:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2398:x1875323801155328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 48us (4016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448490.346585:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 396 00010000:00010000:0.0:1788448490.495972:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448490.686164:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826373888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448490.686231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448490.686444:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448490.686453:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826374016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448490.686476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.687906:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826373888 00000100:00100000:2.0:1788448490.687919:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826373888 00000100:00100000:2.0:1788448490.688751:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374016 00000100:00100000:2.0:1788448490.688759:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374016 00000100:00100000:2.0:1788448490.688854:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788448490.688864:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826373888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448490.688924:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448490.689241:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826373888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 215us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.689250:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788448490.689269:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788448490.689276:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826374016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448490.689287:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448490.689315:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826374016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 40us (2837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.689337:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788448490.690454:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186264000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826373888:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448490.690486:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826374016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448491.198152:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826374144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448491.198223:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448491.198405:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374144 00000100:00100000:0.0:1788448491.198412:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374144 00000100:00100000:0.0:1788448491.198462:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788448491.198480:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826374144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448491.198513:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788448491.198570:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826374144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448491.198577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788448491.199011:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826374144:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788448491.519599:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448492.547597:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448492.736952:0:8427:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1788448492.743187:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1788448492.743202:0:6496:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788448492.743267:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788448492.743284:0:6549:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1788448492.821416:0:14959:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:14:51 (1788448491) 00000100:00100000:3.0:1788448493.246154:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448493.246175:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826374272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448493.246238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448493.246349:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374272 00000100:00100000:1.0:1788448493.246357:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374272 00000100:00100000:1.0:1788448493.246411:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788448493.246421:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826374272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788448493.246446:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00080000:3.0:1788448493.246568:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448493.246747:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826374400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448493.246776:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448493.246799:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448493.246805:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826374528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448493.246829:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448493.246856:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374400 00000100:00100000:0.0:1788448493.246860:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374400 00000100:00100000:0.0:1788448493.246911:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448493.246918:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826374400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448493.246928:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788448493.246964:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826374400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448493.246971:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448493.246991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374528 00000100:00100000:0.0:1788448493.246994:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374528 00000100:00100000:0.0:1788448493.247025:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788448493.247032:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826374528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448493.247053:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448493.247078:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826374528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448493.247084:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:0.0:1788448493.247099:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448493.247122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826374528:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448493.247131:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788448493.247135:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc083ff1c00, transno 4294967325 00000100:00100000:0.0:1788448493.247145:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826374400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448493.247540:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826374272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1119us (1299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448493.247555:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788448493.252368:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826374272:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788448493.574161:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448494.591028:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448495.294579:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826374656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.294638:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826374912:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.294668:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448495.294722:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374656 00000100:00100000:2.0:1788448495.294729:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374656 00000100:00100000:2.0:1788448495.294920:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788448495.294930:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826374656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.295984:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826375040:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297556:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826375168:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.297644:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826375680:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297669:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.297688:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826376192:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297711:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.297740:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788448495.297762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826374784:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.297808:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826375296:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297829:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.297845:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826375808:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.297864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.298013:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375168 00000100:00100000:0.0:1788448495.298020:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375168 00000100:00100000:0.0:1788448495.298062:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788448495.298071:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826375168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298122:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826375168:12345-0@lo:400:kworker.0 Request processed in 52us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.298130:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:0.0:1788448495.298153:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375680 00000100:00100000:0.0:1788448495.298157:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375680 00000100:00100000:0.0:1788448495.298187:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376192 00000100:00100000:0.0:1788448495.298190:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376192 00000100:00100000:0.0:1788448495.298208:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788448495.298215:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826375680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298246:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826375680:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.298252:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788448495.298364:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788448495.298374:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826376192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298408:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826376192:12345-0@lo:400:kworker.0 Request processed in 36us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.298414:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:0.0:1788448495.298579:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448495.298583:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448495.298618:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826375168:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826375680:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298638:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826376192:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298713:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374784 00000100:00100000:0.0:1788448495.298717:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374784 00000100:00100000:0.0:1788448495.298744:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375296 00000100:00100000:0.0:1788448495.298748:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375296 00000100:00100000:0.0:1788448495.298770:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375808 00000100:00100000:0.0:1788448495.298773:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375808 00000100:00100000:0.0:1788448495.298803:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788448495.298809:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826374784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298846:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826374784:12345-0@lo:400:kworker.0 Request processed in 38us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.298853:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788448495.298865:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788448495.298871:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826375296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.298917:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826375296:12345-0@lo:400:kworker.0 Request processed in 46us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.299014:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788448495.299028:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788448495.299035:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.299063:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826375808:12345-0@lo:400:kworker.0 Request processed in 29us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.299069:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:0.0:1788448495.299173:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448495.299193:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826374784:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.299204:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826375296:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.299213:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826375808:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.300784:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448495.300836:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826375424:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.300897:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448495.300919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826375936:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.300941:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448495.300980:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375424 00000100:00100000:1.0:1788448495.300986:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375424 00000100:00100000:1.0:1788448495.301044:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375936 00000100:00100000:1.0:1788448495.301048:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375936 00000100:00100000:1.0:1788448495.301071:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788448495.301079:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826375424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.301287:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826375424:12345-0@lo:400:kworker.0 Request processed in 208us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448495.301295:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788448495.301313:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788448495.301331:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826375936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.301362:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826375936:12345-0@lo:400:kworker.0 Request processed in 43us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448495.301367:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00080000:1.0:1788448495.301388:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788448495.301416:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083f63480 x1875323826375424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448495.301446:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826375424:0@lo:400:kworker.0 00010000:00080000:1.0:1788448495.301458:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083f62a00 x1875323826375936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448495.301467:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826375936:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.301903:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.301903:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826374912 00000100:00100000:0.0:1788448495.301911:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826374912 00000100:00100000:2.0:1788448495.301915:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192027850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826374656:12345-0@lo:400:kworker.0 Request processed in 6984us (7244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.301927:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788448495.301938:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826375552:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.301954:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788448495.301965:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826374912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.301976:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448495.301995:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375040 00000100:00100000:2.0:1788448495.302011:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375040 00000100:00100000:3.0:1788448495.302018:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826376064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.302034:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826374912:12345-0@lo:400:kworker.0 Request processed in 71us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.302042:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1788448495.302047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788448495.302059:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448495.302069:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826375040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.302088:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826375552 00000100:00100000:0.0:1788448495.302094:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826375552 00000100:00100000:2.0:1788448495.302116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826375040:12345-0@lo:400:kworker.0 Request processed in 60us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.302123:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788448495.302130:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376064 00000100:00100000:0.0:1788448495.302135:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376064 00000100:00100000:0.0:1788448495.302162:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788448495.302169:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826375552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.302201:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826375552:12345-0@lo:400:kworker.0 Request processed in 33us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.302208:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788448495.302223:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788448495.302230:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826376064:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788448495.302235:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448495.302240:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448495.302262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826374656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.302293:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826374912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.302353:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826375040:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.302364:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826375552:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.303706:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826376064:12345-0@lo:400:kworker.0 Request processed in 1472us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.303717:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788448495.304213:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826376064:0@lo:400:kworker.0 00000100:00100000:2.0:1788448495.465410:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448495.465457:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448495.465495:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448495.465526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448495.465551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448495.465566:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156608 00000100:00100000:2.0:1788448495.465571:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448495.465594:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156608 00000100:00100000:2.0:1788448495.465617:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448495.465641:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156736 00000100:00100000:2.0:1788448495.465646:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156736 00000100:00100000:0.0:1788448495.465664:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:0.0:1788448495.465685:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801156608:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448495.465689:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156352 00000100:00100000:1.0:1788448495.465695:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156352 00000100:00100000:2.0:1788448495.465699:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 178 00000100:00100000:2.0:1788448495.465710:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801156736:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448495.465731:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156480 00000100:00100000:1.0:1788448495.465736:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156480 00000100:00100000:0.0:1788448495.465755:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2401:x1875323801156608:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448495.465761:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156864 00000100:00100000:0.0:1788448495.465765:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 177 00000100:00100000:1.0:1788448495.465767:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156864 00000100:00100000:3.0:1788448495.465782:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156224 00000100:00100000:3.0:1788448495.465789:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156224 00000100:00100000:1.0:1788448495.465789:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801156992 00000100:00100000:1.0:1788448495.465795:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801156992 00000100:00100000:1.0:1788448495.465823:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 372 00000100:00100000:3.0:1788448495.465830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 398 00000100:00100000:1.0:1788448495.465836:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2401:x1875323801156352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448495.465839:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 373 00000100:00100000:3.0:1788448495.465846:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801156224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448495.465854:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801156480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448495.467018:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801156736:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1162us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.467030:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 178 00000100:00100000:2.0:1788448495.467067:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 374 00000100:00100000:2.0:1788448495.467076:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2401:x1875323801156864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448495.467114:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2401:x1875323801156864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.467120:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 374 00000100:00100000:2.0:1788448495.467136:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 375 00000100:00100000:2.0:1788448495.467143:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801156992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448495.467179:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2400:x1875323801156992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.467184:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 375 00000100:00100000:3.0:1788448495.468253:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192026850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2400:x1875323801156224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2406us (2788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448495.468263:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 398 00000100:00080000:3.0:1788448495.468365:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448495.468539:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448495.468545:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448495.468547:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448495.468908:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:2401:x1875323801156352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3074us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448495.468920:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 372 00000100:00100000:0.0:1788448495.470747:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2400:x1875323801156480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 4483us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.470759:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 373 00010000:00010000:2.0:1788448495.615084:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448495.806294:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826376320:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448495.806372:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448495.806483:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376320 00000100:00100000:1.0:1788448495.806491:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376320 00000100:00100000:1.0:1788448495.806541:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788448495.806551:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826376320:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448495.806587:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00002000:00000024:1.0:1788448495.806588:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448495.806597:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826376448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448495.806621:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448495.806648:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376448 00000100:00100000:2.0:1788448495.806652:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376448 00000100:00100000:2.0:1788448495.806674:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788448495.806680:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826376448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448495.806696:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788448495.806737:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826376448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.806744:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788448495.807589:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826376448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448495.807599:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826376320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1050us (1227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448495.807606:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788448495.807657:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186265500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826376320:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788448496.062263:0:13801:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448496.062271:0:13801:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448496.062370:0:13801:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788448496.062376:0:13801:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448496.283784:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448496.283939:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801157248 00000100:00100000:0.0:1788448496.283949:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801157248 00000100:00100000:0.0:1788448496.284019:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1788448496.284030:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+18:13184:x1875323801157248:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:0.0:1788448496.284266:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:13184:x1875323801157248:12345-192.168.206.21@tcp:35:umount.0 Request processed in 237us (491us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788448496.284274:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:2.0:1788448496.290355:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448496.291094:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801157504 00000100:00100000:0.0:1788448496.291103:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801157504 00000100:00100000:0.0:1788448496.291163:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:0.0:1788448496.291173:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+19:13184:x1875323801157504:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:0.0:1788448496.291458:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:13184:x1875323801157504:12345-192.168.206.21@tcp:35:umount.0 Request processed in 286us (1113us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788448496.291466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:2.0:1788448496.298639:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448496.298843:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801157760 00000100:00100000:1.0:1788448496.298852:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801157760 00000100:00100000:1.0:1788448496.298939:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:1.0:1788448496.298948:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc196b98450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+20:13184:x1875323801157760:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:1.0:1788448496.301238:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc196b98450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:13184:x1875323801157760:12345-192.168.206.21@tcp:35:umount.0 Request processed in 2282us (2600us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1788448496.301251:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:2.0:1788448496.303426:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448496.307912:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801158016 00000100:00100000:3.0:1788448496.307926:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801158016 00000100:00100000:3.0:1788448496.308066:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:3.0:1788448496.308077:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+21:13184:x1875323801158016:12345-192.168.206.21@tcp:35:umount.0 00000100:00100000:3.0:1788448496.308374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:13184:x1875323801158016:12345-192.168.206.21@tcp:35:umount.0 Request processed in 298us (4955us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788448496.308382:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:2.0:1788448496.320062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448496.320100:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448496.320127:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448496.320157:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448496.320187:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801158144 00000100:00100000:2.0:1788448496.320195:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801158144 00000100:00100000:2.0:1788448496.320241:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801158272 00000100:00100000:2.0:1788448496.320244:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801158272 00000100:00100000:2.0:1788448496.320255:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801158400 00000100:00100000:2.0:1788448496.320257:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801158400 00000100:00100000:2.0:1788448496.320270:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1788448496.320279:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+15:2399:x1875323801158144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448496.320292:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448496.320310:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8400/0xf45a9e4e6b80378d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04cd expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448496.320344:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448496.320549:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+14:2399:x1875323801158144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 269us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448496.320558:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:2.0:1788448496.320576:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1788448496.320582:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+13:2399:x1875323801158272:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448496.320590:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448496.320600:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b8036d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e048e expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448496.320609:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448496.320628:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+12:2399:x1875323801158272:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 46us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448496.320634:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:2.0:1788448496.320647:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:2.0:1788448496.320653:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2398:x1875323801158400:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448496.320660:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448496.320670:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0330600/0xf45a9e4e6b8039a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05a6 expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448496.320799:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448496.320820:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+10:2398:x1875323801158400:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 167us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448496.320827:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448496.321046:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801158528 00000100:00100000:1.0:1788448496.321052:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801158528 00000100:00100000:1.0:1788448496.321085:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:1.0:1788448496.321092:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2397:x1875323801158528:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:1.0:1788448496.321113:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803aab 00000100:00080000:1.0:1788448496.321120:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf883000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448496.321159:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788448496.321537:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5f39813a-d0bd-49ee-95eb-2130028b48f0+2:2397:x1875323801158528:12345-192.168.206.21@tcp:9:umount.0 Request processed in 445us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448496.321545:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00010000:00010000:1.0:1788448496.321578:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448496.322825:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448496.322845:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826376576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448496.322937:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448496.323259:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376576 00000100:00100000:0.0:1788448496.323268:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376576 00000100:00100000:0.0:1788448496.323321:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788448496.323330:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826376576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448496.323360:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788448496.323421:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826376576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448496.323427:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:0.0:1788448496.323467:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826376576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448496.325849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448496.326125:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801158912 00000100:00100000:1.0:1788448496.326141:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801158912 00000100:00100000:1.0:1788448496.326223:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:1.0:1788448496.326234:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2397:x1875323801158912:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:1.0:1788448496.326261:0:8539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803d21 00000020:00010000:1.0:1788448496.326268:0:8539:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc1bf857800: total 0 00000100:00080000:1.0:1788448496.326273:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9fc199804800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448496.326327:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788448496.326532:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2397:x1875323801158912:12345-192.168.206.21@tcp:9:umount.0 Request processed in 300us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448496.326541:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000020:00010000:2.0:1788448496.326576:0:9523:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc1bf857800: total 0 00010000:00010000:2.0:1788448496.326612:0:9523:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc1bf857800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1788448496.326662:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000310d1ba0/0xf45a9e4e6b8040d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0790 expref: 4 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448496.326713:0:9523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b8047a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0973 expref: 3 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448496.326728:0:9523:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc1bf857800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1788448496.326741:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448496.326743:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448496.326744:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448496.344624:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448496.344784:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801159936 00000100:00100000:2.0:1788448496.344793:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801159936 00000100:00100000:2.0:1788448496.344912:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 258 00000100:00100000:2.0:1788448496.344924:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+22:2397:x1875323801159936:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:2.0:1788448496.344953:0:9023:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8036de 00000020:00010000:2.0:1788448496.344965:0:9023:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc082760000: total 0 00000100:00080000:2.0:1788448496.344969:0:9023:0:(import.c:65:import_set_state_nolock()) ffff9fc082760800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448496.344992:0:9023:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:1.0:1788448496.345143:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc082760000: total 0 00010000:00010000:1.0:1788448496.345187:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc082760000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788448496.345263:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc183b52700) 00010000:00010000:1.0:1788448496.345267:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448496.345274:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031400/0xf45a9e4e6b803a0a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05b4 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345324:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448496.345327:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788448496.345331:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc180031a00/0xf45a9e4e6b80415e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07b3 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345343:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448496.345346:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448496.345349:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fc00/0xf45a9e4e6b804769 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e095e expref: 19 pid: 13811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345360:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:1.0:1788448496.345375:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448496.345379:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351e200/0xf45a9e4e6b803fba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0743 expref: 18 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345391:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9fc08319cc00) 00010000:00010000:1.0:1788448496.345394:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448496.345397:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e400/0xf45a9e4e6b80444b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e088c expref: 17 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345410:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:1.0:1788448496.345412:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448496.345416:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f800/0xf45a9e4e6b804142 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e07ac expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345426:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448496.345428:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788448496.345431:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331800/0xf45a9e4e6b804793 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e096c expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345450:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448496.345452:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788448496.345456:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351fe00/0xf45a9e4e6b803a81 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05d0 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345467:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:1.0:1788448496.345469:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788448496.345473:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351ec00/0xf45a9e4e6b8040c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0789 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345497:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9fc1bb42b300) 00010000:00010000:1.0:1788448496.345499:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448496.345503:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1e000/0xf45a9e4e6b803d7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e06a9 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345518:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc1bb543500) 00010000:00010000:1.0:1788448496.345521:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448496.345524:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330c00/0xf45a9e4e6b803a26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e05bb expref: 11 pid: 13810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345538:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9fc08336af00) 00010000:00010000:1.0:1788448496.345540:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448496.345543:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331200/0xf45a9e4e6b80409a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e077b expref: 10 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345556:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9fc1bb543b00) 00010000:00010000:1.0:1788448496.345558:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448496.345562:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc08351f000/0xf45a9e4e6b804689 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0926 expref: 9 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448496.345573:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc082760000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788448496.345586:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448496.345588:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448496.345590:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448496.346219:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5f39813a-d0bd-49ee-95eb-2130028b48f0+7:2397:x1875323801159936:12345-192.168.206.21@tcp:39:umount.0 Request processed in 1293us (1600us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1788448496.346228:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 258 00000100:00100000:0.0:1788448496.354833:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448496.355173:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801160064 00000100:00100000:3.0:1788448496.355215:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801160064 00000100:00100000:3.0:1788448496.355286:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 259 00000100:00100000:3.0:1788448496.355299:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+5:2397:x1875323801160064:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:3.0:1788448496.355341:0:13810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8036e5 00000100:00080000:3.0:1788448496.355364:0:13810:0:(import.c:65:import_set_state_nolock()) ffff9fc1b5c9e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788448496.355397:0:13810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1788448496.355421:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448496.355610:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5f39813a-d0bd-49ee-95eb-2130028b48f0+3:2397:x1875323801160064:12345-192.168.206.21@tcp:39:umount.0 Request processed in 311us (789us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788448496.355619:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 259 00010000:00010000:1.0:1788448496.638331:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448496.766563:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788448497.662828:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448497.732464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448497.732523:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448497.732590:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801160192 00000100:00100000:0.0:1788448497.732605:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801160192 00000100:00100000:0.0:1788448497.732684:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801160320 00000100:00100000:0.0:1788448497.732688:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801160320 00000100:00100000:0.0:1788448497.732732:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1788448497.732747:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2398:x1875323801160192:12345-192.168.206.21@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788448497.732764:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00010000:00010000:0.0:1788448497.732765:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788448497.732788:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+11:2398:x1875323801160320:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448497.732798:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8a00/0xf45a9e4e6b8037e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04e2 expref: 11 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448497.732817:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448497.732821:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448497.732841:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9200/0xf45a9e4e6b8037e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0513 expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448497.732859:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448497.732946:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:2398:x1875323801160192:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 201us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448497.732971:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:1.0:1788448497.732980:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+9:2398:x1875323801160320:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 197us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448497.732999:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:0.0:1788448497.735101:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448497.735166:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801160448 00000100:00100000:1.0:1788448497.735182:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801160448 00000100:00100000:1.0:1788448497.735269:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:1.0:1788448497.735289:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+8:2399:x1875323801160448:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448497.735309:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448497.735332:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8e00/0xf45a9e4e6b8039a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e059f expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448497.735354:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448497.735431:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+7:2399:x1875323801160448:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 152us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448497.735439:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1788448497.756656:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448497.756776:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801160704 00000100:00100000:1.0:1788448497.756786:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801160704 00000100:00100000:1.0:1788448497.756854:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 260 00000100:00100000:1.0:1788448497.756865:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+6:2397:x1875323801160704:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:1.0:1788448497.756951:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8037f6 00000020:00010000:1.0:1788448497.756959:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc0835aa000: total 0 00000100:00080000:1.0:1788448497.756963:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ac000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448497.757011:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:1.0:1788448497.757164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2397:x1875323801160704:12345-192.168.206.21@tcp:39:umount.0 Request processed in 301us (517us total) trans 4294967528 rc 0/0 00000100:00100000:1.0:1788448497.757172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 260 00000020:00010000:2.0:1788448497.757266:0:6506:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc0835aa000: total 0 00010000:00010000:2.0:1788448497.757324:0:6506:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc0835aa000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788448497.757358:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08336a200) 00010000:00010000:2.0:1788448497.757361:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448497.757369:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc18152f600/0xf45a9e4e6b8047b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e097a expref: 4 pid: 9023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448497.757389:0:6506:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc0835aa000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788448497.757401:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448497.757403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448497.757405:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448497.757930:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448497.772598:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448497.772716:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801160832 00000100:00100000:2.0:1788448497.772725:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801160832 00000100:00100000:2.0:1788448497.772793:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 261 00000100:00100000:2.0:1788448497.772803:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+5:2397:x1875323801160832:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:2.0:1788448497.772841:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8037fd 00000100:00080000:2.0:1788448497.772850:0:6518:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ab800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448497.773519:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788448497.773676:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:66d43c2c-d252-43d9-8f04-1c7a728a06f0+3:2397:x1875323801160832:12345-192.168.206.21@tcp:39:umount.0 Request processed in 872us (1087us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788448497.773696:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 261 00000100:00080000:3.0:1788448497.774450:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788448497.778347:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448497.812506:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448497.812600:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161088 00000100:00100000:2.0:1788448497.812609:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161088 00000100:00100000:2.0:1788448497.812661:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 399 00000100:00100000:2.0:1788448497.812672:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+7:2397:x1875323801161088:12345-192.168.206.21@tcp:251:umount.0 00000020:00000080:2.0:1788448497.812724:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8036bb 00000020:00010000:2.0:1788448497.812732:0:6510:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc0834f8000: total 0 00000100:00080000:2.0:1788448497.812737:0:6510:0:(import.c:65:import_set_state_nolock()) ffff9fc0834fb800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788448497.812866:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:898f976d-b4cc-4a0f-acd9-17aca9f1b33b+3:2397:x1875323801161088:12345-192.168.206.21@tcp:251:umount.0 Request processed in 195us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448497.812917:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 399 00000020:00010000:1.0:1788448497.813103:0:9522:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc0834f8000: total 0 00010000:00010000:1.0:1788448497.813107:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448497.813154:0:9522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc0834f8000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788448497.813186:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204a400/0xf45a9e4e6b803794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e04d4 expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448497.813207:0:9522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc0834f8000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788448497.813220:0:9522:0:(genops.c:885:class_export_put()) final put ffff9fc0834f8000/898f976d-b4cc-4a0f-acd9-17aca9f1b33b 00010000:00010000:1.0:1788448497.813237:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448497.813239:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448497.813241:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448497.813707:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0834f8000/898f976d-b4cc-4a0f-acd9-17aca9f1b33b for MGS 00000020:00000080:2.0:1788448497.813744:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0834fb800 for MGS 00000100:00100000:2.0:1788448498.366863:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448498.366894:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826376704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448498.366952:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448498.367028:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376704 00000100:00100000:2.0:1788448498.367035:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376704 00000100:00100000:2.0:1788448498.367080:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788448498.367088:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826376704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448498.367112:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788448498.367148:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826376704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448498.367155:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1788448498.367173:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448498.367203:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826376704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448498.367513:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448498.367523:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826376832:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448498.367552:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448498.367580:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826376960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448498.367604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448498.367632:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376832 00000100:00100000:0.0:1788448498.367635:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376832 00000100:00100000:0.0:1788448498.367665:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788448498.367671:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826376832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448498.367681:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788448498.367711:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826376832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448498.367716:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788448498.367735:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826376960 00000100:00100000:0.0:1788448498.367738:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826376960 00000100:00100000:0.0:1788448498.367761:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788448498.367767:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826376960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448498.367788:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788448498.367818:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826376960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448498.367824:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00080000:0.0:1788448498.367908:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448498.367929:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826376960:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448498.367966:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826376832:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788448498.370968:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:00080000:0.0:1788448498.370981:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1788448498.370997:0:6496:0:(genops.c:885:class_export_put()) final put ffff9fc0835aa000/66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:00100000:0.0:1788448498.371014:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000001:00080000:0.0:1788448498.371019:0:6496:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1788448498.371030:0:6496:0:(genops.c:885:class_export_put()) final put ffff9fc082760000/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:2.0:1788448498.371124:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835aa000/66d43c2c-d252-43d9-8f04-1c7a728a06f0 for lustre-MDT0000 00000020:00000080:2.0:1788448498.371187:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082760000/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-MDT0000 00000020:00000080:2.0:1788448498.371224:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835ac000 for lustre-MDT0000 00000020:00000080:2.0:1788448498.371229:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc082760800 for lustre-MDT0000 00010000:00010000:3.0:1788448498.687936:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788448499.516660:0:15155:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788448499.556354:0:15155:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788448499.556408:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.556421:0:15155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.556428:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.556436:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.556468:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448499.556485:0:15155:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788448499.556515:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448499.556519:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448499.556525:0:15155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788448499.556546:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba070800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788448499.556619:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448499.556626:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.556633:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448499.556643:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.556651:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448499.556658:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448499.556663:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448499.556665:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788448499.556668:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788448499.556690:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.556696:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448499.556726:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448499.556729:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826377088:0@lo:39:umount.0 00010000:00010000:2.0:1788448499.556739:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b200/0xf45a9e4e6b803763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80376a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.556752:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448499.556754:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448499.556757:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448499.556801:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448499.556803:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826377216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448499.556850:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448499.556916:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377216 00000100:00100000:3.0:1788448499.556924:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377216 00000100:00100000:3.0:1788448499.556974:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448499.556995:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3648:x1875323826377216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448499.557007:0:13187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448499.557022:0:13187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b80376a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803763 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448499.557035:0:13187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448499.557071:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3648:x1875323826377216:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448499.557078:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448499.557135:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826377216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448499.557228:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377088 00000100:00100000:2.0:1788448499.557234:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377088 00000100:00100000:2.0:1788448499.557273:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788448499.557282:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875323826377088:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788448499.557302:0:13810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8032d2 00000100:00080000:2.0:1788448499.557310:0:13810:0:(import.c:65:import_set_state_nolock()) ffff9fc191364800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788448499.557387:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1875323826377088:12345-0@lo:39:umount.0 Request processed in 106us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448499.557395:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:2.0:1788448499.557405:0:13810:0:(genops.c:885:class_export_put()) final put ffff9fc1ba061000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788448499.557431:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448499.557440:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba061000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448499.557504:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc191364800 for lustre-MDT0000 00000100:00080000:3.0:1788448499.557706:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba070800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788448499.557731:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826377088:0@lo:39:umount.0 00000100:00080000:2.0:1788448499.558241:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448499.558245:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448499.558249:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788448499.560152:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560174:0:15155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560181:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560188:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560264:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448499.560279:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560286:0:15155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560292:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560329:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560606:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448499.560614:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560620:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448499.560624:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560633:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448499.560641:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448499.560647:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448499.560649:0:9522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788448499.560681:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560688:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448499.560723:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560731:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b803771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803778 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560756:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448499.560760:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560765:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448499.560768:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.560775:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448499.560783:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.560790:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826377344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448499.560858:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:0.0:1788448499.560864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448499.560869:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560878:0:15155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560904:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560911:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560925:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448499.560936:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448499.560941:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.560948:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331e00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448499.560951:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.560956:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377344 00010000:00010000:2.0:1788448499.560959:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.560963:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377344 10000000:00010000:2.0:1788448499.560973:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448499.560996:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788448499.560999:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788448499.561002:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:0.0:1788448499.561020:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788448499.561021:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561029:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788448499.561034:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3645:x1875323826377344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448499.561043:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448499.561048:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448499.561051:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331e00/0xf45a9e4e6b8039d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8039e0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561062:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448499.561064:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448499.561066:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204ae00/0xf45a9e4e6b803778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803771 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561067:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448499.561080:0:15155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448499.561083:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448499.561090:0:15155:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561096:0:15155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561102:0:15155:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561115:0:15155:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788448499.561119:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3645:x1875323826377344:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (254us total) trans 0 rc 0/0 10000000:01000000:2.0:1788448499.561120:0:15155:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:0.0:1788448499.561129:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 10000000:01000000:2.0:1788448499.561131:0:15155:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1788448499.561169:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448499.561175:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.561181:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826377344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448499.561184:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448499.561190:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561196:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.561198:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:2.0:1788448499.561208:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.561208:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826377472:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788448499.561217:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448499.561219:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788448499.561220:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788448499.561238:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.561243:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788448499.561250:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448499.561262:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448499.561274:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448499.561282:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826377600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448499.561302:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:1.0:1788448499.561468:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448499.561472:0:9522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788448499.561474:0:9522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788448499.561490:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.561496:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448499.561513:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.561520:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f000/0xf45a9e4e6b803675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80367c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.561536:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448499.561538:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448499.561546:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448499.561552:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448499.561563:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826377728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448499.561595:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448499.561625:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377472 00000100:00100000:1.0:1788448499.561629:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377472 00000100:00100000:1.0:1788448499.561652:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377600 00000100:00100000:1.0:1788448499.561655:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377600 00000100:00100000:1.0:1788448499.561665:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377728 00000100:00100000:1.0:1788448499.561667:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377728 00000100:00100000:1.0:1788448499.561678:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448499.561683:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+24:3645:x1875323826377472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448499.561691:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448499.561700:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8200/0xf45a9e4e6b8039e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8039d9 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.561708:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448499.561735:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+23:3645:x1875323826377472:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448499.561741:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448499.561753:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448499.561759:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+22:3648:x1875323826377600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448499.561766:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448499.561773:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b803238 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803231 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.561780:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448499.561814:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+21:3648:x1875323826377600:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448499.561828:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448499.561841:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448499.561847:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19ead2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+20:3647:x1875323826377728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448499.561854:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448499.561862:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181681600/0xf45a9e4e6b80367c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803675 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448499.561872:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448499.561910:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19ead2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3647:x1875323826377728:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448499.561916:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448499.561958:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf85bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826377728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448499.561992:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826377472:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448499.562228:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204b400/0xf45a9e4e6b803231 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803238 expref: -99 pid: 6494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448499.562237:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448499.562239:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448499.562241:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448499.562256:0:15155:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788448499.562515:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788448499.562522:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448499.562529:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/9 00000020:00080000:2.0:1788448499.562533:0:15155:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc1bb749000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448499.562539:0:15155:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc081ac0000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448499.562543:0:15155:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc1b4942800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448499.562547:0:15155:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9fc187ba7000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1788448499.562552:0:15155:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9fc19138cd28) has exports, disconnecting them 00000020:00080000:2.0:1788448499.562555:0:15155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc1bb749000), last request at 1788448495 00000020:00000080:2.0:1788448499.562562:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8035e2 00000100:00080000:2.0:1788448499.562578:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74f800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788448499.562667:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788448499.562679:0:15155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1bb749000): rc 0 00010000:00010000:3.0:1788448499.562682:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448499.562682:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1bb749000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788448499.562693:0:15155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc081ac0000), last request at 1788448495 00000020:00000080:3.0:1788448499.562696:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb749000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448499.562696:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8034bc 00000100:00080000:2.0:1788448499.562701:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac1800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788448499.562710:0:15155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc081ac0000): rc 0 00000020:00000080:2.0:1788448499.562711:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc081ac0000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788448499.562715:0:15155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc1b4942800), last request at 1788448260 00000020:00000080:2.0:1788448499.562717:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8033b9 00000100:00080000:2.0:1788448499.562720:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc1b4943800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788448499.562729:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788448499.562735:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bb74f800 for lustre-MDT0000 00000020:00080000:2.0:1788448499.562735:0:15155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1b4942800): rc 0 00000020:00000080:2.0:1788448499.562737:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1b4942800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788448499.562740:0:15155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9fc187ba7000), last request at 1788448260 00000020:00000080:3.0:1788448499.562741:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac0000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448499.562743:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80337a 00000100:00080000:2.0:1788448499.562753:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23c000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788448499.562759:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b4942800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:2.0:1788448499.562763:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1788448499.562768:0:15155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00000080:3.0:1788448499.562776:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc081ac1800 for lustre-MDT0000 00000020:00000080:3.0:1788448499.562780:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b4943800 for lustre-MDT0000 00000020:00080000:2.0:1788448499.562846:0:15155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc187ba7000): rc 0 00000004:00000080:2.0:1788448499.562852:0:15155:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbf8c0109fae0 00000100:00080000:2.0:1788448499.562868:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448499.562877:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00000100:00100000:0.0:1788448499.562903:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826377600:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448499.563476:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448499.564225:0:15155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788448499.564251:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb4a4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448499.564404:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826377856:0@lo:39:umount.0 00000100:00100000:3.0:1788448499.564463:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448499.564680:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377856 00000100:00100000:0.0:1788448499.564688:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377856 00000100:00100000:0.0:1788448499.564734:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788448499.564745:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875323826377856:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788448499.564772:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803414 00000100:00080000:0.0:1788448499.564779:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59ee000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788448499.564817:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:2.0:1788448499.564830:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788448499.564834:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788448499.564847:0:15155:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1788448499.564918:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448499.564990:0:15155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788448499.565001:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf74f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448499.565438:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826377984:0@lo:9:umount.0 00000100:00100000:3.0:1788448499.565470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788448499.568167:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788448499.568175:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1788448499.568200:0:15155:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788448499.568268:0:15155:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788448499.568296:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc083576000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788448499.568335:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc19138cd28) has no exports 00000100:00100000:2.0:1788448499.568972:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826377984 00000100:00100000:2.0:1788448499.568991:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826377984 00000100:00100000:2.0:1788448499.569077:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448499.569091:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1875323826377984:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788448499.569124:0:8431:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803564 00000100:00080000:2.0:1788448499.569132:0:8431:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba27f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448499.569180:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788448499.569369:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3644:x1875323826377984:12345-0@lo:9:umount.0 Request processed in 282us (3896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448499.569387:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1788448499.569406:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448499.575547:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3644:x1875323826377856:12345-0@lo:39:umount.0 Request processed in 10697us (10977us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788448499.575562:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00080000:3.0:1788448499.579216:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb4a4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788448499.579231:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826377856:0@lo:39:umount.0 00000100:00100000:3.0:1788448499.579251:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826378112:0@lo:9:umount.0 00000100:00100000:3.0:1788448499.579306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788448499.579355:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf74f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788448499.579367:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788448499.579369:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448499.579371:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826377984:0@lo:9:umount.0 00000100:00100000:2.0:1788448499.582029:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378112 00000100:00100000:2.0:1788448499.582042:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378112 00000100:00080000:0.0:1788448499.582103:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448499.582110:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788448499.582122:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875323826378112:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788448499.582146:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8036a6 00000100:00080000:2.0:1788448499.582154:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9fc0835af800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448499.582200:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788448499.582295:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448499.582357:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3644:x1875323826378112:12345-0@lo:9:umount.0 Request processed in 237us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448499.582365:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788448499.582387:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083576000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788448499.582508:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788448499.582511:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448499.582516:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826378112:0@lo:9:umount.0 00000020:00080000:2.0:1788448499.587905:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9fc19138cd28) has no exports 00000020:00000080:2.0:1788448499.651274:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80328c 00000020:00000080:2.0:1788448499.651291:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1913a0000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788448499.651373:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788448499.651494:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1913a0000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788448499.651532:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448499.651543:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788448499.651547:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9fc1ba05cd28) has no exports 00000020:00000080:3.0:1788448499.651804:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803285 00000020:00000080:3.0:1788448499.651810:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc191361000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788448499.651898:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448499.651905:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788448499.651909:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc191364000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788448499.651911:0:15155:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc191364000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788448499.651925:0:15155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788448499.652575:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc191361000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788448499.710057:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448500.414195:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826378368:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448500.414315:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826378496:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.414349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.414369:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826378880:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.414384:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826379008:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414391:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448500.414403:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.414412:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788448500.414418:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826378240:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.414419:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788448500.414422:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826378624:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.414441:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.414442:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448500.414454:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826379136:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414460:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826378752:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.414471:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.414483:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378240 00000100:00100000:3.0:1788448500.414490:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378240 00000100:00100000:0.0:1788448500.414495:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378496 00000100:00100000:0.0:1788448500.414497:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378496 00000100:00100000:3.0:1788448500.414545:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788448500.414554:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3646:x1875323826378240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414597:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192023850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3646:x1875323826378240:12345-0@lo:400:kworker.0 Request processed in 44us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448500.414604:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:3.0:1788448500.414633:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.414649:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826379264:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414670:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.414698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3646:1875323826378240:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414749:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378880 00000100:00100000:3.0:1788448500.414752:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378880 00000100:00100000:3.0:1788448500.414787:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379264 00000100:00100000:3.0:1788448500.414789:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379264 00000100:00100000:3.0:1788448500.414805:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788448500.414810:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826378880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414853:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186264000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826378880:12345-0@lo:400:kworker.0 Request processed in 32us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448500.414859:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788448500.414870:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788448500.414875:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826379264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414927:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826379264:12345-0@lo:400:kworker.0 Request processed in 52us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448500.414932:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788448500.414966:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826379264:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.414987:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826378880:0@lo:400:kworker.0 00000100:00080000:3.0:1788448500.415010:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448500.415014:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448500.415328:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378624 00000100:00100000:0.0:1788448500.415328:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379008 00000100:00100000:1.0:1788448500.415333:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378624 00000100:00100000:0.0:1788448500.415333:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379008 00000100:00100000:0.0:1788448500.415345:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379136 00000100:00100000:1.0:1788448500.415347:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378752 00000100:00100000:0.0:1788448500.415347:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379136 00000100:00100000:1.0:1788448500.415349:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378752 00000100:00100000:0.0:1788448500.415367:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788448500.415373:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826379136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448500.415398:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826378368 00000100:00100000:2.0:1788448500.415402:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826378368 00000100:00100000:0.0:1788448500.415410:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826379136:12345-0@lo:400:kworker.0 Request processed in 37us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448500.415415:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788448500.415425:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788448500.415427:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788448500.415430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875323826378368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.415430:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1875323826378496:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788448500.415436:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000020:00080000:0.0:1788448500.415436:0:13811:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788448500.415458:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1875323826378496:12345-0@lo:400:kworker.0 Request processed in 27us (1109us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788448500.415464:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186265500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3646:x1875323826378368:12345-0@lo:400:kworker.0 Request processed in 33us (1155us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788448500.415464:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788448500.415469:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788448500.415475:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788448500.415479:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1875323826379008:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788448500.415484:0:13811:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788448500.415490:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788448500.415494:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875323826378624:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788448500.415498:0:6518:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788448500.415539:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3647:x1875323826378624:12345-0@lo:400:kworker.0 Request processed in 42us (1096us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788448500.415545:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788448500.415569:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:0+-99:3647:x1875323826379008:12345-0@lo:400:kworker.0 Request processed in 31us (1108us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788448500.415575:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788448500.415580:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788448500.415585:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e8000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788448500.415589:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788448500.415650:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788448500.415653:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788448500.415656:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788448500.415660:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448500.415664:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 199 00000100:00080000:3.0:1788448500.415668:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc1b59e9000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448500.415687:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc186267800 x1875323826379392/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448500.415704:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826378624:0@lo:400:kworker.0 00010000:00080000:3.0:1788448500.415723:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7ca680 x1875323826379136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448500.415732:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826379136:0@lo:400:kworker.0 00000100:00080000:3.0:1788448500.415741:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788448500.415744:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788448500.415747:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788448500.415749:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448500.415752:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 177 00000100:00080000:3.0:1788448500.415756:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc1ba23b800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448500.415768:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc186267100 x1875323826379520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448500.415777:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826378496:0@lo:400:kworker.0 00000100:00080000:3.0:1788448500.415787:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788448500.415789:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788448500.415792:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788448500.415794:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448500.415797:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 220 00000100:00080000:3.0:1788448500.415800:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc0831cf000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448500.415812:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc186267b80 x1875323826379648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448500.415821:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826379008:0@lo:400:kworker.0 00000100:00100000:3.0:1788448500.415858:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826379392:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788448500.415916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.415935:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826379520:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788448500.415955:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.415990:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379392 00000100:00100000:3.0:1788448500.415993:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379392 00000100:00100000:3.0:1788448500.416009:0:13810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379520 00000100:00100000:3.0:1788448500.416012:0:13810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379520 00000100:00100000:3.0:1788448500.416023:0:13810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788448500.416028:0:13810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875323826379392:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:3.0:1788448500.416041:0:13810:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788448500.420436:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788448500.420449:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826378752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.420747:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826378752:12345-0@lo:400:kworker.0 Request processed in 299us (6111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448500.420755:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788448500.420772:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788448500.420789:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826379520:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788448500.420804:0:6519:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788448500.420830:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826379520:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 40us (4875us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448500.420836:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788448500.421061:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448500.421066:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448500.421070:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826379520:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788448500.421080:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826379648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788448500.421111:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448500.421133:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379648 00000100:00100000:1.0:1788448500.421137:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379648 00000100:00100000:1.0:1788448500.421153:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788448500.421158:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826379648:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788448500.421165:0:6519:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788448500.421185:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826379648:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 26us (73us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448500.421190:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788448500.421207:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448500.421210:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448500.421213:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826379648:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1788448500.422115:0:13810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186266300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3644:x1875323826379392:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 6083us (6196us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788448500.422123:0:13810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1788448500.422164:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448500.422170:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448500.422173:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826379392:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:0.0:1788448500.422339:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448500.454442:0:3646:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448500.454455:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 177 00000100:00080000:2.0:1788448500.454464:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc1b59e8000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448500.454530:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf7c9f80 x1875323826379776/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448500.454563:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826378368:0@lo:400:kworker.0 00010000:00080000:2.0:1788448500.454609:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bf7cbb80 x1875323826378752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448500.454620:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826378752:0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.454744:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826379776:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788448500.454814:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448500.455759:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379776 00000100:00100000:2.0:1788448500.455767:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379776 00000100:00100000:2.0:1788448500.455809:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788448500.455816:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826379776:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788448500.455832:0:6523:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788448500.455914:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf85ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826379776:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 98us (1100us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788448500.455922:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00080000:1.0:1788448500.456118:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448500.456124:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448500.456127:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826379776:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:1.0:1788448500.734057:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448500.926702:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448500.926724:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826379904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448500.926856:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.927134:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826379904 00000100:00100000:3.0:1788448500.927144:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826379904 00000100:00100000:3.0:1788448500.927195:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788448500.927204:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826379904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448500.927231:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448500.927283:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf858a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826379904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448500.927290:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448500.927462:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826379904:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788448501.444064:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448501.444074:0:9511:0:(genops.c:885:class_export_put()) final put ffff9fc0835a9000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788448501.444098:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:1.0:1788448501.444101:0:9511:0:(genops.c:885:class_export_put()) final put ffff9fc1bf885800/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:2.0:1788448501.444203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835a9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788448501.444250:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf885800/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-OST0001 00000020:00000080:2.0:1788448501.444284:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835af800 for lustre-OST0001 00000020:00000080:2.0:1788448501.444289:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bf883000 for lustre-OST0001 00000001:00100000:0.0:1788448501.446290:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788448501.446299:0:8427:0:(genops.c:885:class_export_put()) final put ffff9fc1ba27d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788448501.446434:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:0.0:1788448501.446437:0:8427:0:(genops.c:885:class_export_put()) final put ffff9fc1bf857800/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:3.0:1788448501.446464:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba27d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788448501.446519:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1ba27f800 for lustre-OST0000 00000020:00000080:2.0:1788448501.446758:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf857800/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-OST0000 00000020:00000080:2.0:1788448501.447191:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc199804800 for lustre-OST0000 00010000:00010000:2.0:1788448501.758239:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788448502.467195:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788448502.467210:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1788448502.467216:0:7448:0:(genops.c:885:class_export_put()) final put ffff9fc1ba23a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788448502.467240:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:00080000:0.0:1788448502.467245:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1788448502.467248:0:7448:0:(genops.c:885:class_export_put()) final put ffff9fc0835ad000/66d43c2c-d252-43d9-8f04-1c7a728a06f0 00000001:00100000:0.0:1788448502.467254:0:7448:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5f39813a-d0bd-49ee-95eb-2130028b48f0 00000001:00080000:0.0:1788448502.467259:0:7448:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1788448502.467260:0:7448:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c99000/5f39813a-d0bd-49ee-95eb-2130028b48f0 00000020:00000080:2.0:1788448502.467414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba23a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788448502.467477:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0835ad000/66d43c2c-d252-43d9-8f04-1c7a728a06f0 for lustre-MDT0001 00000020:00000080:2.0:1788448502.467496:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c99000/5f39813a-d0bd-49ee-95eb-2130028b48f0 for lustre-MDT0001 00000020:00000080:2.0:1788448502.467515:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b59ee000 for lustre-MDT0001 00000020:00000080:2.0:1788448502.467520:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0835ab800 for lustre-MDT0001 00000020:00000080:2.0:1788448502.467524:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b5c9e000 for lustre-MDT0001 00010000:00010000:0.0:1788448502.785249:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448503.486239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826380032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448503.486306:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448503.486437:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380032 00000100:00100000:2.0:1788448503.486445:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380032 00000100:00100000:2.0:1788448503.486506:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788448503.486516:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826380032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448503.486543:0:8436:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788448503.486585:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826380032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448503.486592:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:3.0:1788448503.486649:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448503.486682:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826380032:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788448503.806042:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448504.830109:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448505.540801:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448505.540808:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448505.540811:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448505.540819:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788448505.540824:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448505.540830:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc1b59e8000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448505.540851:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d0e00 x1875323826380288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448505.540873:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448505.540877:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448505.540913:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:1.0:1788448505.540913:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788448505.540922:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788448505.540929:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:1.0:1788448505.540932:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826380160:0@lo:400:kworker.0 00000100:00080000:3.0:1788448505.540936:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc1ba23b800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448505.540967:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d0000 x1875323826380416/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448505.540976:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448505.540979:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448505.540981:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448505.540985:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788448505.540987:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448505.540991:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc1b59e9000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448505.541002:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d1880 x1875323826380544/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448505.541026:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788448505.541078:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448505.541083:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448505.541085:0:38:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448505.541089:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 417 00000100:00080000:3.0:1788448505.541092:0:38:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448505.541096:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc0831cf000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448505.541109:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d2a00 x1875323826380928/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448505.541110:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380160 00000100:00100000:1.0:1788448505.541118:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380160 00000100:00100000:1.0:1788448505.541165:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788448505.541167:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826380672:0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.541177:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3647:x1875323826380160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.541210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448505.541235:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc192021050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb+19:3647:x1875323826380160:12345-0@lo:400:kworker.0 Request processed in 60us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448505.541243:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448505.541244:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788448505.541252:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826380800:0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.541277:0:13811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380672 00000100:00100000:1.0:1788448505.541287:0:13811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380672 00000100:00100000:3.0:1788448505.541301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448505.541328:0:13811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788448505.541335:0:13811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826380672:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788448505.541338:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448505.541357:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380800 00000100:00100000:3.0:1788448505.541361:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380800 00000100:00100000:1.0:1788448505.541374:0:13811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826380672:12345-0@lo:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448505.541381:0:13811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788448505.541410:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788448505.541418:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826380800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.541438:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826381056:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.541456:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826380800:12345-0@lo:400:kworker.0 Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448505.541463:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788448505.541475:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788448505.541481:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448505.541510:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826380160:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.541511:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826380800:0@lo:400:kworker.0 00010000:00080000:3.0:1788448505.541533:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d3800 x1875323826380672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448505.541533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448505.541553:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826381184:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.541571:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826380672:0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.541583:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.541607:0:9023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381056 00000100:00100000:3.0:1788448505.541613:0:9023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381056 00000100:00080000:1.0:1788448505.541646:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448505.541656:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1788448505.541664:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826381056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.541708:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826381056:12345-0@lo:400:kworker.0 Request processed in 46us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448505.541714:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788448505.541794:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381184 00000100:00100000:2.0:1788448505.541799:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381184 00000100:00100000:0.0:1788448505.541821:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826380288:0@lo:38:kworker.0 00000100:00100000:2.0:1788448505.541832:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788448505.541840:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc186267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826381184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448505.541860:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448505.541901:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc186267b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826381184:12345-0@lo:400:kworker.0 Request processed in 62us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448505.541908:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826380416:0@lo:38:kworker.0 00000100:00100000:2.0:1788448505.541909:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788448505.541936:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380288 00000100:00100000:0.0:1788448505.541938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448505.541959:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380288 00000100:00100000:0.0:1788448505.541969:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826380544:0@lo:38:kworker.0 00000100:00100000:2.0:1788448505.541988:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788448505.541996:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826380288:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788448505.541998:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:02000000:2.0:1788448505.542015:0:6523:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788448505.542022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826380928:0@lo:38:kworker.0 00000100:00100000:0.0:1788448505.542046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788448505.542083:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448505.542103:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380416 00000100:00100000:0.0:1788448505.542107:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380416 00000100:00100000:0.0:1788448505.542122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380544 00000100:00100000:0.0:1788448505.542124:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380544 00000100:00100000:0.0:1788448505.542131:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826380928 00000100:00100000:0.0:1788448505.542133:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826380928 00000100:00100000:0.0:1788448505.542144:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788448505.542148:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826380416:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788448505.542156:0:6517:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788448505.542211:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826380416:12345-0@lo:38:kworker.0 Request processed in 61us (273us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448505.542218:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788448505.542264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788448505.542268:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826380544:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788448505.542276:0:6517:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788448505.542307:0:9023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788448505.542309:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826380544:12345-0@lo:38:kworker.0 Request processed in 37us (312us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788448505.542318:0:9023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875323826380928:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788448505.542321:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00010000:02000000:3.0:1788448505.542332:0:9023:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1788448505.542350:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448505.542357:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448505.542362:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826380416:0@lo:38:kworker.0 00000100:00100000:3.0:1788448505.542368:0:9023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875323826380928:12345-0@lo:38:kworker.0 Request processed in 50us (319us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788448505.542376:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1788448505.542377:0:9023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1788448505.542384:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448505.542388:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826380544:0@lo:38:kworker.0 00000100:00080000:0.0:1788448505.542398:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448505.542403:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448505.542405:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826380928:0@lo:38:kworker.0 00000100:00100000:1.0:1788448505.542921:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826381184:0@lo:400:kworker.0 00010000:00080000:1.0:1788448505.542933:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0835d3100 x1875323826381056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448505.542941:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826381056:0@lo:400:kworker.0 00000001:00100000:3.0:1788448505.544395:0:6496:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788448505.544402:0:6496:0:(genops.c:885:class_export_put()) final put ffff9fc187ba7000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788448505.544478:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187ba7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788448505.544708:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1ba23c000 for lustre-MDT0000 00000100:00100000:2.0:1788448505.554558:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826380288:12345-0@lo:38:kworker.0 Request processed in 12554us (12691us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788448505.554573:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00080000:0.0:1788448505.558098:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e8000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448505.558108:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448505.558112:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826380288:0@lo:38:kworker.0 00000020:01000000:3.0:1788448505.726270:0:15155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc083122e40 - data ffff9fc081cb8af8/ffff9fc0834c6400 00000020:01000000:3.0:1788448505.726449:0:15155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1c12f24e0 - data ffff9fc1ad907000/ffff9fc1ba1e4000 00000001:00000004:3.0:1788448505.737257:0:15155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788448505.818245:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448505.818254:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788448505.818268:0:15155:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9fc083f61500 x1875323826377856/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788448509 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448505.818292:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788448505.820043:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788448505.820048:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788448505.820064:0:15155:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448505.820066:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788448505.820337:0:8536:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788448505.820342:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1788448505.820352:0:8536:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788448505.820965:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788448505.820970:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:3.0:1788448505.820980:0:15155:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448505.820990:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788448505.822215:0:9909:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788448505.822221:0:9909:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788448505.822231:0:9909:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788448505.823456:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803254 00000020:00000080:3.0:1788448505.823466:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc187bf7000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788448505.823991:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187bf7000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788448505.827453:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803269 00000020:00000080:3.0:1788448505.827466:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1913a5800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788448505.827487:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788448505.827493:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448505.827500:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788448505.827504:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9fc1913899b8) has no exports 00000020:00000080:1.0:1788448505.828699:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1913a5800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:3.0:1788448505.829293:0:15155:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788448505.829306:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80369f 00000020:00000080:3.0:1788448505.829314:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc0834fc000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788448505.829334:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788448505.829341:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448505.829353:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788448505.829357:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9fc1bb7999b8) has no exports 00000020:00000080:3.0:1788448505.829364:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803698 00000020:00000080:3.0:1788448505.829368:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc083576800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788448505.831098:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0834fc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788448505.831112:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083576800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788448505.831693:0:15155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788448505.831697:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788448505.831701:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788448505.831718:0:15155:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448505.831721:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788448505.831762:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448505.831773:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788448505.831780:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80355d 00000020:00000080:3.0:1788448505.831787:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1ba279800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788448505.831791:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788448505.831797:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448505.831802:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788448505.831806:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9fc1b5d5b370) has no exports 00000020:00000080:3.0:1788448505.831811:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803556 00000020:00000080:3.0:1788448505.831814:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1bf74a000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788448505.832164:0:15155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788448505.832167:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788448505.832170:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788448505.832173:0:15155:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788448505.832174:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788448505.832196:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448505.832201:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788448505.832221:0:15155:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788448505.832226:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80340d 00000020:00000080:3.0:1788448505.832270:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1ba073800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788448505.832275:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788448505.832278:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448505.832282:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788448505.832285:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9fc1bb53b370) has no exports 00000020:00000080:3.0:1788448505.832289:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803406 00000020:00000080:3.0:1788448505.832291:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1bb4a6800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788448505.832739:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc083576000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788448505.832752:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc083573800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448505.832755:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc083573800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788448505.832760:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448505.832831:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba279800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788448505.832836:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf74a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788448505.832840:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bf74f000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788448505.832844:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc1bf725800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448505.832846:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf725800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788448505.832850:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448505.832876:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba073800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788448505.832899:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb4a6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788448505.848958:0:15155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788448505.848970:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448505.848974:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788448505.848983:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448505.849039:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448505.849055:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448505.849098:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448505.849102:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448505.849109:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc187bf2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448505.849114:0:15155:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187bf2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788448505.849128:0:15155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448505.849243:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803270 00000020:00000080:2.0:1788448505.849250:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1913a0800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788448505.849254:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788448505.849266:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448505.849271:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788448505.849274:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9fc191388000) has no exports 00000020:00000080:2.0:1788448505.849296:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448505.849299:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788448505.849304:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803277 00000020:00000080:2.0:1788448505.849307:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1913a7800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788448505.849315:0:15155:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc190ac6000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788448505.849318:0:15155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc190ac6000 3 00000020:01000004:2.0:1788448505.849320:0:15155:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc190ac6000 from lustre-MDT0000 00000020:00000080:2.0:1788448505.849338:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448505.849340:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788448505.849343:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc187bf2000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788448505.849345:0:15155:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187bf2000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788448505.849350:0:15155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788448505.849378:0:15155:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788448505.849381:0:15155:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788448505.849383:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788448505.849385:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448505.849387:0:15155:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788448505.849393:0:15155:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9fc182d6f000 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448505.849397:0:15155:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9fc1aeb48000) has exports, disconnecting them 00000020:00080000:2.0:1788448505.849401:0:15155:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9fc182d6f000), last request at 1788448240 00000020:00000080:2.0:1788448505.849413:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803215 00000020:00010000:2.0:1788448505.849416:0:15155:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9fc182d6f000: total 2 00000100:00080000:2.0:1788448505.849419:0:15155:0:(import.c:65:import_set_state_nolock()) ffff9fc182d69800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788448505.849433:0:15155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc182d6f000): rc 0 00000020:00080000:2.0:1788448505.849436:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9fc1aeb48000) has no exports 00000020:00010000:2.0:1788448505.849446:0:6505:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9fc182d6f000: total 2 00010000:00010000:2.0:1788448505.849471:0:6505:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9fc182d6f000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788448505.849504:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204a600/0xf45a9e4e6b803740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803739 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788448505.849601:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bb4a4000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788448505.849608:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc1ba075800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448505.849610:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba075800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00010000:00010000:2.0:1788448505.849629:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351ee00/0xf45a9e4e6b80374e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803747 expref: 13 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849643:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f800/0xf45a9e4e6b80331f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803318 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849660:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc181680400/0xf45a9e4e6b80375c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b803755 expref: 11 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849674:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1f600/0xf45a9e4e6b803311 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80330a expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849687:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8800/0xf45a9e4e6b803716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80370f expref: 9 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849696:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351e600/0xf45a9e4e6b8039c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8039bd expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849704:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc180031800/0xf45a9e4e6b8039b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8039af expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849715:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8c00/0xf45a9e4e6b803786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80377f expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849723:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a9600/0xf45a9e4e6b803724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80371d expref: 5 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849731:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1bb4a8000/0xf45a9e4e6b8039d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b8039cb expref: 4 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849755:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b803636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80362f expref: 3 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849770:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b803732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf45a9e4e6b80372b expref: 2 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448505.849781:0:6505:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9fc182d6f000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788448505.849797:0:6505:0:(genops.c:885:class_export_put()) final put ffff9fc182d6f000/7c63b88e-7c0d-40d0-a31b-5bfffe0befbb 00010000:00010000:2.0:1788448505.849809:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448505.849812:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448505.849814:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448505.849901:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9fc191704800:6510] 1 exiting: rc = 0 00000020:01000000:1.0:1788448505.850137:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448505.850188:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1913a0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788448505.850192:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc187bf6800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788448505.850194:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187bf6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788448505.850197:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788448505.850221:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1913a7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788448505.850225:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc182d6f000/7c63b88e-7c0d-40d0-a31b-5bfffe0befbb for MGS 00000020:00000080:1.0:1788448505.850242:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc182d69800 for MGS 00000100:00100000:1.0:1788448505.850268:0:6511:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9fc1c1192c00:6511] 2 exiting: rc = 0 00000100:00100000:2.0:1788448505.853022:0:6509:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9fc191705400:6509] 0 exiting: rc = 1 00000100:00100000:1.0:1788448505.853182:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853191:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853197:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853203:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853222:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853229:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853236:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853242:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853247:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853253:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853259:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853266:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853272:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853278:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853285:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853292:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853299:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853306:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853312:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853318:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853324:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853330:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853336:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853343:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853349:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853354:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853361:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853366:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853372:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853377:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853383:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853389:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853395:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853401:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853407:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853412:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853417:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853423:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853429:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853442:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853447:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853452:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853457:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853462:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853467:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853472:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853478:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853483:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853489:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853494:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853500:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853506:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853511:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853516:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853521:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853526:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853531:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853549:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853555:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853561:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853566:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853572:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853578:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448505.853584:0:15155:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788448505.857791:0:15155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc083254d20 - data ffff9fc081cbba20/ffff9fc081aa8c00 00000020:01000000:1.0:1788448505.858035:0:15155:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1b02b9000 - data ffff9fc1ad8926c0/ffff9fc1aebe4000 00000020:00000080:1.0:1788448505.858449:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8031f9 00000020:00000080:1.0:1788448505.858457:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc191745000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788448505.858474:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc191745000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788448505.858486:0:15155:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc190ac6000 from MGS, refs=2 00000020:01000004:1.0:1788448505.858489:0:15155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc190ac6000 2 00000020:01000004:1.0:1788448505.858492:0:15155:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc190ac6000 from MGS 00000020:00000080:1.0:1788448505.858512:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448505.858531:0:15155:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788448505.858700:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc191740000/MGS 00000020:00000080:1.0:1788448505.858703:0:15155:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc191740000/MGS for MGS 00000020:01000000:1.0:1788448505.858709:0:15155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788448505.858767:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788448505.858771:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448505.858777:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788448505.858783:0:15155:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9fc1ba072800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448505.858789:0:15155:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9fc1aeb499b8) has exports, disconnecting them 00000020:00080000:1.0:1788448505.858794:0:15155:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9fc1ba072800), last request at 1788448241 00000020:00000080:1.0:1788448505.858797:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8032c4 00000020:00080000:1.0:1788448505.858806:0:15155:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1ba072800): rc 0 00000020:00000080:1.0:1788448505.858811:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc1ba072800/lustre-MDT0000-lwp-MDT0000 00010000:00010000:0.0:1788448505.858856:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448505.859516:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba072800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788448505.860012:0:15155:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788448505.860017:0:15155:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448505.860021:0:15155:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788448505.860026:0:15155:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448505.860045:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1ba070800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788448505.860178:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448505.860185:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788448505.860189:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc187ba5000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788448505.860191:0:15155:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc187ba5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788448505.860196:0:15155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788448505.860262:0:15155:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc190ac6000 1 00000020:00000080:2.0:1788448505.860267:0:15155:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8031eb 00000020:00000080:2.0:1788448505.860272:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc191741800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788448505.860279:0:15155:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788448505.860294:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc191741800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788448505.860302:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448505.860307:0:15155:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788448505.860310:0:15155:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9fc1aeb4cd28) has no exports 00000020:00000080:2.0:1788448505.967183:0:15155:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448505.967194:0:15155:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788448505.967199:0:15155:0:(genops.c:885:class_export_put()) final put ffff9fc185686000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788448505.967204:0:15155:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc185686000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788448505.967210:0:15155:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788448505.967327:0:15155:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc190ac4000 00000020:02000400:2.0:1788448505.967382:0:15155:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788448506.051412:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448506.051435:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826381312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448506.051496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448506.051674:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381312 00000100:00100000:3.0:1788448506.051682:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381312 00000100:00100000:3.0:1788448506.052650:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788448506.052663:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826381312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448506.052692:0:8435:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788448506.052748:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826381312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448506.052756:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788448506.056858:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826381312:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788448506.877957:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448507.006514:0:13803:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448507.903016:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448508.608994:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448508.609014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826381440:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448508.609084:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448508.609141:0:11085:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381440 00000100:00100000:3.0:1788448508.609148:0:11085:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381440 00000100:00100000:3.0:1788448508.609210:0:11085:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788448508.609220:0:11085:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826381440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448508.609246:0:11085:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788448508.609286:0:11085:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826381440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448508.609294:0:11085:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1788448508.609316:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448508.609413:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826381440:0@lo:13:osp-pre-0-1.0 00000020:01000004:2.0:1788448508.910548:0:15356:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00010000:00010000:2.0:1788448508.927860:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448508.936031:0:15356:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1788448508.936156:0:15356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.936171:0:15356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.936178:0:15356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.936185:0:15356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.936209:0:15356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788448508.936214:0:15356:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788448508.936243:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448508.936247:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788448508.936253:0:15356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788448508.936270:0:15356:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba23b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788448508.936276:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448508.936277:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448508.936280:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788448508.936742:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448508.936750:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.936758:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448508.936762:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.936770:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448508.936777:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448508.936794:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448508.936797:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788448508.936799:0:6506:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788448508.936835:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.936841:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448508.936874:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.936899:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181681400/0xf45a9e4e6b803747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80374e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.936911:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448508.936911:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc186267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826381568:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448508.936913:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448508.936914:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448508.936991:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448508.937222:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381568 00000100:00100000:1.0:1788448508.937229:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381568 00000100:00100000:1.0:1788448508.937267:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448508.937274:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875323826381568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788448508.937280:0:6502:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448508 with bad export cookie 17607559752806576661 00010000:00010000:2.0:1788448508.939322:0:15356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939342:0:15356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939350:0:15356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939357:0:15356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939384:0:15356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448508.939412:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448508.939420:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939427:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448508.939431:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939439:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448508.939447:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448508.939452:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448508.939455:0:9522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1788448508.939467:0:15356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939473:0:15356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939479:0:15356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939484:0:15356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939487:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939493:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448508.939499:0:15356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448508.939513:0:15356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939519:0:15356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939525:0:15356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939528:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939531:0:15356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939535:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181681200/0xf45a9e4e6b803755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80375c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939543:0:15356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788448508.939550:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448508.939553:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448508.939553:0:9522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939557:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939559:0:9522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152ee00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448508.939562:0:9522:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939563:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc180030000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448508.939566:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939570:0:9522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939573:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448508.939576:0:9522:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448508.939579:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448508.939581:0:9522:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448508.939584:0:9522:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788448508.939585:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788448508.939585:0:9522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 10000000:01000000:2.0:1788448508.939586:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788448508.939588:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788448508.939597:0:9522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939599:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939603:0:9522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448508.939608:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448508.939615:0:9522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939616:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.939622:0:9522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b80362f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b803636 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939623:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc180030000/0xf45a9e4e6b8039cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b8039d2 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939634:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448508.939636:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448508.939637:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448508.939644:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448508.939645:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448508.939647:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448508.939648:0:15356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939654:0:15356:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939660:0:15356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448508.939660:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788448508.939665:0:15356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448508.939687:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826381696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448508.939688:0:15356:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788448508.939691:0:15356:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788448508.939696:0:15356:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788448508.939730:0:15356:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788448508.939733:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788448508.939738:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448508.939743:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788448508.939748:0:15356:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc081ac2000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:0.0:1788448508.939754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788448508.939758:0:15356:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9fc1b7388000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448508.939763:0:15356:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9fc1ba05b370) has exports, disconnecting them 00000020:00080000:2.0:1788448508.939768:0:15356:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc081ac2000), last request at 1788448505 00000020:00000080:2.0:1788448508.939773:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8035f7 00000100:00080000:2.0:1788448508.939788:0:15356:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac5000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788448508.939818:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448508.939822:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939828:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204bc00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448508.939831:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939837:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448508.939843:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448508.939848:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448508.939850:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788448508.939852:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788448508.939866:0:6505:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939872:0:6505:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448508.939905:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939913:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204bc00/0xf45a9e4e6b803318 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf45a9e4e6b80331f expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.939947:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448508.939949:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448508.939951:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788448508.939965:0:15356:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc081ac2000): rc 0 00000020:00000080:2.0:1788448508.939967:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc081ac2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1788448508.939976:0:15356:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9fc1b7388000), last request at 1788448505 00000020:00000080:2.0:1788448508.939980:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8034d1 00000100:00080000:2.0:1788448508.939985:0:15356:0:(import.c:65:import_set_state_nolock()) ffff9fc1b738b800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788448508.939993:0:15356:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1b7388000): rc 0 00000020:00000080:2.0:1788448508.939995:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1b7388000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788448508.940002:0:15356:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbf8c01c5fae0 00000100:00080000:2.0:1788448508.940018:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448508.940022:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00100000:3.0:1788448508.940631:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448508.940645:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826382080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448508.940683:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448508.940724:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826381824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448508.940747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448508.940763:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788448508.940765:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448508.940768:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826381952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448508.940788:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448508.940811:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381696 00000100:00100000:3.0:1788448508.940817:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381696 00000100:00100000:3.0:1788448508.940840:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826382080 00000100:00100000:3.0:1788448508.940842:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826382080 00000100:00100000:3.0:1788448508.940850:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381824 00000100:00100000:3.0:1788448508.940852:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381824 00000100:00100000:3.0:1788448508.940858:0:13187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826381952 00000100:00100000:3.0:1788448508.940861:0:13187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826381952 00000100:00100000:3.0:1788448508.940899:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448508.940916:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875323826381696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788448508.940922:0:13187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448508 with bad export cookie 17607559752806576661 00010000:00010000:0.0:1788448508.940968:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448508.940975:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3647:x1875323826381696:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1221us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788448508.940982:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448508.940999:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448508.941003:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875323826382080:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788448508.941007:0:13187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448508 with bad export cookie 17607559752806576661 00000100:00100000:3.0:1788448508.941101:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3648:x1875323826382080:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (416us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788448508.941107:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448508.941121:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448508.941125:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875323826381824:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788448508.941129:0:13187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448508 with bad export cookie 17607559752806576661 00000100:00100000:3.0:1788448508.941160:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875323826381824:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (411us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788448508.941165:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448508.941177:0:13187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788448508.941181:0:13187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875323826381952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788448508.941185:0:13187:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448508 with bad export cookie 17607559752806576661 00000100:00100000:3.0:1788448508.941209:0:13187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1875323826381952:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (420us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788448508.941214:0:13187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000020:00000080:3.0:1788448508.941232:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788448508.941276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b7388000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788448508.941298:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc081ac5000 for lustre-MDT0001 00000020:00000080:3.0:1788448508.941309:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b738b800 for lustre-MDT0001 00000100:00080000:3.0:1788448508.941338:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788448508.941342:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788448508.941345:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.121@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788448508.941939:0:15356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788448508.941945:0:15356:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e8000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788448508.943125:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788448508.944114:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.121@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1788448508.949301:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448508.949381:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875323826381568:12345-0@lo:103:ldlm_bl.0 Request processed in 12102us (12387us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788448508.949391:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788448508.949501:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448508.949506:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788448508.949521:0:15356:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788448508.950952:0:15356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788448508.950996:0:15356:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf726800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788448508.951018:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788448508.951021:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788448508.951035:0:15356:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788448508.951094:0:15356:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788448508.951103:0:15356:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788448508.951130:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fc1ba05b370) has no exports 00000100:00100000:1.0:1788448508.951321:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826382208:0@lo:9:umount.0 00000100:00100000:1.0:1788448508.951381:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448508.951409:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826382336:0@lo:9:umount.0 00000100:00100000:1.0:1788448508.951430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448508.951465:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826382208 00000100:00100000:1.0:1788448508.951473:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826382208 00000100:00100000:1.0:1788448508.951508:0:8539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826382336 00000100:00100000:1.0:1788448508.951512:0:8539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826382336 00000100:00100000:1.0:1788448508.951540:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448508.951549:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875323826382208:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788448508.951572:0:8539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80351e 00000100:00080000:1.0:1788448508.951581:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf724000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448508.951617:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788448508.951783:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1875323826382208:12345-0@lo:9:umount.0 Request processed in 234us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448508.951791:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448508.953071:0:8539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788448508.953087:0:8539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1875323826382336:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788448508.953111:0:8539:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803660 00000100:00080000:1.0:1788448508.953118:0:8539:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448508.953173:0:8539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788448508.953299:0:8539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3644:x1875323826382336:12345-0@lo:9:umount.0 Request processed in 219us (1867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448508.953307:0:8539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788448508.953353:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bf726800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788448508.953359:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788448508.953361:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448508.953364:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826382208:0@lo:9:umount.0 00000100:00080000:1.0:1788448508.953377:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788448508.953381:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788448508.953382:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448508.953384:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826382336:0@lo:9:umount.0 00010000:00010000:1.0:1788448508.953421:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788448508.953446:0:6513:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788448508.953502:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448508.972236:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.121@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788448508.972242:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788448508.972250:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc186267100 x1875323826381568/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448524 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448508.972264:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137ed80 x1875323826381696/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448524 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448508.972273:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bf7c9180 x1875323826382080/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448524 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448508.972280:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137d180 x1875323826381824/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448524 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448508.972288:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bf7cb100 x1875323826381952/t0(0) o103->MGC192.168.206.121@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448524 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788448508.972363:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fc183e92800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:3.0:1788448508.972458:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788448508.972461:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 00000100:00100000:2.0:1788448508.972461:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc186267100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826381568:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1788448508.972463:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788448508.972466:0:3645:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448508.972478:0:3648:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9fc183e92800 already not connected (conn 2, was 1): CONNECTING 00000100:00100000:1.0:1788448508.972535:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3648:1875323826382080:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448508.977959:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3647:1875323826381696:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788448508.978008:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 158 00000100:00080000:3.0:1788448508.978018:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc183e92800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448508.978068:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d1f80 x1875323826382464/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448508.978120:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826381824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448508.978134:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3645:1875323826381952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448508.978185:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826382464:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788448508.978230:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323826382464 offset 0 length 520: 4 00000020:00080000:3.0:1788448508.983094:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9fc1ba05b370) has no exports 00000020:01000000:2.0:1788448509.028260:0:15356:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1b5ae5360 - data ffff9fc1adb1dbd0/ffff9fc083562000 00000020:01000000:2.0:1788448509.028531:0:15356:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc186397ea0 - data ffff9fc191848438/ffff9fc1b48d3800 00000001:00000004:2.0:1788448509.038667:0:15356:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:1.0:1788448509.088724:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448509.088733:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788448509.088740:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788448509.090158:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448509.090165:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788448509.090176:0:15356:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448509.090178:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788448509.090850:0:8530:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788448509.090855:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1788448509.090865:0:8530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788448509.091853:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788448509.091859:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:1.0:1788448509.091902:0:15356:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448509.091906:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788448509.092122:0:9903:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788448509.092126:0:9903:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:3.0:1788448509.092135:0:9903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788448509.098451:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80333b 00000020:00000080:0.0:1788448509.098471:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2b4800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788448509.100655:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803350 00000020:00000080:0.0:1788448509.100668:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1b4947000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.100818:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2b4800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788448509.101037:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:0.0:1788448509.101052:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448509.101060:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448509.101065:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9fc1ba058000) has no exports 00000004:01000000:0.0:1788448509.101228:0:15356:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788448509.101238:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803659 00000020:00000080:0.0:1788448509.101242:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc0834fd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.101375:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b4947000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788448509.101448:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788448509.101452:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448509.101460:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788448509.101462:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9fc1bb538000) has no exports 00000020:00000080:0.0:1788448509.101468:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803652 00000020:00000080:0.0:1788448509.101478:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc0831cc000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788448509.101498:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0834fd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:0.0:1788448509.102019:0:15356:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788448509.102023:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788448509.102027:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:0.0:1788448509.102033:0:15356:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448509.102035:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448509.103019:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cc000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788448509.103232:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448509.103245:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448509.103254:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803517 00000020:00000080:0.0:1788448509.103262:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1ba279000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.103335:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0831cd000 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788448509.103341:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc0831cf800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.103343:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cf800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788448509.103348:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788448509.103472:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:0.0:1788448509.103477:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448509.103487:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788448509.103491:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9fc1b5d58000) has no exports 00000020:00000080:0.0:1788448509.103525:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803510 00000020:00000080:0.0:1788448509.103531:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1bf724800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788448509.103680:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba279000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00010000:01000000:0.0:1788448509.104397:0:15356:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:0.0:1788448509.104401:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788448509.104404:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:0.0:1788448509.104410:0:15356:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788448509.104412:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448509.104459:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf724800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788448509.104605:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448509.104613:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:0.0:1788448509.104628:0:15356:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788448509.104634:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803373 00000020:00000080:0.0:1788448509.104640:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1b4941000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.104666:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bf726800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788448509.104672:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc1bf720000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.104674:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf720000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788448509.104678:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788448509.104791:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:0.0:1788448509.104796:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448509.104810:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788448509.104814:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9fc19ebe8000) has no exports 00000020:00000080:0.0:1788448509.104819:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80336c 00000020:00000080:0.0:1788448509.104823:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1b59e9800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788448509.104975:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b4941000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788448509.112649:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b59e9800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788448509.112953:0:15356:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788448509.112959:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448509.112963:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788448509.112970:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448509.113199:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448509.113213:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448509.113244:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448509.113248:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448509.113254:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2b0000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448509.113258:0:15356:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2b0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788448509.113265:0:15356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448509.113447:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803357 00000020:00000080:1.0:1788448509.113454:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1b4942000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788448509.115000:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b59e8000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788448509.115012:0:38:0:(genops.c:885:class_export_put()) final put ffff9fc1b59ee800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788448509.115019:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b59ee800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788448509.116334:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788448509.117718:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788448509.117789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b4942000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788448509.117822:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448509.117831:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788448509.117835:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9fc1ba0599b8) has no exports 00000020:00000080:3.0:1788448509.117867:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448509.117873:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:3.0:1788448509.117877:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc191362000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788448509.117901:0:15356:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc191362000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788448509.117906:0:15356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788448509.118134:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80335e 00000020:00000080:3.0:1788448509.118142:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1b4944000/lustre-MDT0001-osd_UUID 00000020:01000004:3.0:1788448509.118157:0:15356:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc19ea22000 from lustre-MDT0001, refs=2 00000020:01000004:3.0:1788448509.118161:0:15356:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc19ea22000 2 00000020:01000004:3.0:1788448509.118163:0:15356:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc19ea22000 from lustre-MDT0001 00000020:00000080:3.0:1788448509.118181:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448509.118185:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:3.0:1788448509.118188:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2b4000/lustre-MDT0001_UUID 00000020:00000080:3.0:1788448509.118189:0:15356:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2b4000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:3.0:1788448509.118196:0:15356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:3.0:1788448509.118218:0:15356:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:3.0:1788448509.118221:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:3.0:1788448509.118232:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448509.118236:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788448509.118242:0:15356:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9fc1913a1000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788448509.118247:0:15356:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9fc19138b370) has exports, disconnecting them 00000020:00080000:3.0:1788448509.118252:0:15356:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9fc1913a1000), last request at 1788448260 00000020:00000080:3.0:1788448509.118256:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8033b2 00000020:00080000:3.0:1788448509.118873:0:15356:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1913a1000): rc 0 00000020:00000080:3.0:1788448509.118879:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1913a1000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788448509.119755:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b4944000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788448509.120024:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1913a1000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788448509.155971:0:15356:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788448509.155978:0:15356:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448509.155982:0:15356:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788448509.155989:0:15356:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448509.156017:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1ba23b800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788448509.156258:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448509.156268:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788448509.156280:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1ba23e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788448509.156284:0:15356:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba23e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788448509.156293:0:15356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788448509.156365:0:15356:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc19ea22000 1 00000020:00000080:1.0:1788448509.156372:0:15356:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8032ee 00000020:00000080:1.0:1788448509.156379:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc1ba2b7800/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788448509.156388:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788448509.156396:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba2b7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788448509.156406:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448509.156411:0:15356:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788448509.156415:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9fc19ebecd28) has no exports 00000020:00000080:1.0:1788448509.236575:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448509.236588:0:15356:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:1.0:1788448509.236595:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc19ea22800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788448509.236600:0:15356:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc19ea22800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:1.0:1788448509.236605:0:15356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:1.0:1788448509.236705:0:15356:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc19ea25000 00000020:01000000:1.0:1788448509.236723:0:15356:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788448509.236727:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448509.236731:0:15356:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788448509.236742:0:15356:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9fc1aeb4b370) has no exports 00000100:00100000:3.0:1788448509.236961:0:9023:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9fc082544a00:9023] 3 exiting: rc = 0 00000100:00100000:2.0:1788448509.236961:0:13810:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9fc0826ab600:13810] 4 exiting: rc = 0 00000100:00100000:1.0:1788448509.237099:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9fc1b0287c00:6518] 1 exiting: rc = 0 00000100:00100000:0.0:1788448509.237110:0:6517:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9fc18314c200:6517] 0 exiting: rc = 1 00000100:00100000:2.0:1788448509.238958:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9fc1917c8400:6519] 2 exiting: rc = 0 00000100:00100000:2.0:1788448509.239081:0:13811:0:(service.c:3183:ptlrpc_main()) mdt00_005: service thread [ffff9fc1bb535400:13811] 5 exiting: rc = 0 00000100:00100000:2.0:1788448509.239165:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239173:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239179:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239185:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239194:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239200:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239205:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239211:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239217:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239223:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239229:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239245:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239252:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239258:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239263:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239268:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239274:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239279:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239284:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239289:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239294:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239299:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239304:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239309:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239314:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239318:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239323:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239328:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239334:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239339:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239344:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239350:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239355:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239361:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239366:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239379:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239384:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239390:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239396:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239402:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239407:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239413:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239418:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239423:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239429:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239436:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239442:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239447:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239453:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.239458:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241336:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241342:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241347:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241353:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241358:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241363:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241369:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241374:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241379:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241385:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241390:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241395:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241400:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.241407:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.256085:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9fc1917c9200:6520] 0 exiting: rc = 1 00000100:00100000:1.0:1788448509.256087:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9fc1917c8800:6521] 1 exiting: rc = 0 00000100:00100000:0.0:1788448509.256428:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256437:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256444:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256450:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256455:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256461:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256467:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256473:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256487:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256493:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256499:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256505:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256515:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256521:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256527:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256533:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256538:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256545:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256550:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256555:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256560:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256565:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256569:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256574:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256578:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256583:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256587:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256592:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256596:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256601:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256605:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256609:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256614:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256619:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256638:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256642:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256647:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256651:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256656:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256660:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256665:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256669:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256673:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256677:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256681:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256686:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256691:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256695:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256700:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256704:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256709:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256713:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256718:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256722:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256726:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256731:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256735:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256740:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256744:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256749:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256753:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256758:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256763:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.256767:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.257320:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9fc1917c9600:6523] 1 exiting: rc = 0 00000100:00100000:1.0:1788448509.257648:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9fc1917c8600:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1788448509.258002:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258010:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258017:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258023:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258028:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258045:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258052:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258059:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258065:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258071:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258090:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258097:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258103:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258108:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258114:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258120:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258126:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258132:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258139:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258144:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258151:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258156:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258176:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258183:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258189:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258194:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258199:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258205:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258211:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258217:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258223:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258228:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258233:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258238:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258258:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258265:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258270:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258277:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258283:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258290:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258304:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258310:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258316:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258323:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258329:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258336:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258357:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258365:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258370:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258376:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.258382:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259921:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259943:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259949:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259957:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259963:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259968:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.259974:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.260005:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.260012:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.260019:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.260025:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.260031:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.260045:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448509.278626:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9fc1917c8c00:6525] 1 exiting: rc = 0 00000100:00100000:1.0:1788448509.278734:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9fc1917c8200:6524] 0 exiting: rc = 1 00000100:00100000:3.0:1788448509.281053:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281063:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281069:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281074:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281079:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281085:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281091:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281096:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281102:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281107:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281113:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281118:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281123:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281129:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281134:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281139:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281144:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281150:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281155:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281161:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281166:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281172:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281177:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281183:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281205:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281210:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281215:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281220:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281225:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281230:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281236:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281241:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281245:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281250:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281256:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281261:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281267:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281272:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281277:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281282:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281288:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281293:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281310:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281316:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281321:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281326:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281331:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281336:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281342:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281347:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281352:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281357:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281362:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281368:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281374:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281378:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281383:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281388:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281392:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281405:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281409:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281415:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281420:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.281425:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448509.285510:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9fc18944bc00:6526] 0 exiting: rc = 1 00000100:00100000:0.0:1788448509.286060:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9fc19f415e00:6527] 1 exiting: rc = 0 00000100:00100000:3.0:1788448509.286384:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286392:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286397:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286402:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286408:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286414:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286419:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286424:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286429:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286434:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286440:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286445:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286450:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286454:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286470:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286476:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286480:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286485:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286490:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286494:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286499:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286504:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286509:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286524:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286529:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286534:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286539:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286545:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286550:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286554:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286571:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286576:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286580:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286586:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286591:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286596:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286601:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286605:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286610:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286616:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286621:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286626:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286631:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286637:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286642:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286647:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286652:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286658:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286663:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286669:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286674:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286679:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286685:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286690:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286696:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286701:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286706:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286712:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286718:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286723:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286728:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286733:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286738:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.286744:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448509.287311:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9fc19f416200:6529] 1 exiting: rc = 0 00000100:00100000:0.0:1788448509.288198:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9fc19f417c00:6528] 0 exiting: rc = 1 00000100:00100000:0.0:1788448509.288263:0:7473:0:(service.c:3183:ptlrpc_main()) mdt_fld_0002: service thread [ffff9fc1b5a0d400:7473] 2 exiting: rc = 0 00000100:00100000:3.0:1788448509.288488:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288508:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288757:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288767:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288772:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288778:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288784:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288789:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288804:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288812:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288817:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288823:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288829:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288833:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288839:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288845:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288850:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288856:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288861:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288865:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288870:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.288875:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289031:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289039:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289044:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289048:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289052:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289057:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289061:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289066:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289070:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289075:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289079:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289083:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289088:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289093:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289107:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289111:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289117:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289122:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289127:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289133:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289138:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289143:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289147:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289152:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289156:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289161:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289166:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289171:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289175:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289180:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289185:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289189:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289196:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289204:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289208:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289213:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289218:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289223:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289227:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289232:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289238:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.289244:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448509.290191:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9fc192b64e00:6530] 0 exiting: rc = 1 00000100:00100000:2.0:1788448509.290396:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9fc192014600:6531] 1 exiting: rc = 0 00000100:00100000:1.0:1788448509.290630:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9fc192014e00:6532] 2 exiting: rc = 0 00000100:00100000:3.0:1788448509.291164:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291171:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291177:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291182:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291188:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291194:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291200:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291216:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291221:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291227:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291233:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291238:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291243:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291249:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291254:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291260:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291266:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291272:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291277:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291283:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291289:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291627:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291636:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291642:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291647:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291653:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291658:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291664:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291670:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291676:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291682:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291688:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291693:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291698:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291704:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291709:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291714:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291720:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291726:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291731:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291736:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291741:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291755:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291761:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291766:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291782:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291789:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291805:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291811:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291817:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291823:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291828:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291834:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291840:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291845:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291851:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291856:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291862:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291872:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291878:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291915:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291921:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291938:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448509.291944:0:15356:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788448509.304628:0:15356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448509.304652:0:15356:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788448509.304657:0:15356:0:(genops.c:885:class_export_put()) final put ffff9fc19ea23800/MDS_uuid 00000020:00000080:2.0:1788448509.304662:0:15356:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc19ea23800/MDS_uuid for MDS 00000020:01000000:2.0:1788448509.304668:0:15356:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788448509.304809:0:15356:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788448509.951969:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448510.654091:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448510.654104:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448510.654107:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448510.654135:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788448510.654140:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448510.654150:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 422 00000100:00080000:0.0:1788448510.654157:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448510.654166:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc1b59e9000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448510.654214:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137e300 x1875323826382592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448510.654280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448510.654284:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788448510.654285:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448510.654290:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 422 00000100:00080000:0.0:1788448510.654292:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448510.654296:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc0831cf000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448510.654308:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137d500 x1875323826382848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448510.654353:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448510.654371:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826382976:0@lo:400:kworker.0 00000400:00000100:0.0:1788448510.654431:0:3646:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826382976 offset 0 length 224: 4 00000100:00100000:2.0:1788448510.654547:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826382592:0@lo:38:kworker.0 00000400:00000100:2.0:1788448510.654574:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826382592 offset 0 length 520: 4 00000100:00100000:2.0:1788448510.654590:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826382848:0@lo:38:kworker.0 00000400:00000100:2.0:1788448510.654603:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826382848 offset 0 length 520: 4 00000100:00100000:2.0:1788448510.654622:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448510.654629:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826382720:0@lo:400:kworker.0 00000400:00000100:2.0:1788448510.654648:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826382720 offset 0 length 224: 4 00010000:00010000:2.0:1788448510.978808:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448511.999778:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788448512.777262:0:15557:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788448512.792177:0:15557:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788448512.792230:0:15557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.792245:0:15557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.792253:0:15557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.792260:0:15557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.792283:0:15557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788448512.792288:0:15557:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788448512.792328:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448512.792339:0:15557:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137e300 x1875323826382592/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448512.792357:0:15557:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788448512.792386:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448512.792391:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788448512.792395:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826382592:0@lo:38:kworker.0 00000100:00080000:2.0:1788448512.792423:0:15557:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788448512.792428:0:15557:0:(import.c:65:import_set_state_nolock()) ffff9fc1b59e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788448512.792433:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448512.792435:0:15557:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448512.792438:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788448512.793045:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448512.793054:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.793062:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181681000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448512.793066:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.793088:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448512.793106:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448512.793113:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448512.793115:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788448512.793117:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788448512.793130:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:0.0:1788448512.793134:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.793141:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181681000/0xf45a9e4e6b80372b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803732 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.793156:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448512.793158:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448512.793159:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448512.794387:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448512.794402:0:15557:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137f100 x1875323826382720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448512.794717:0:15557:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788448512.794724:0:15557:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788448512.794748:0:15557:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac1000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448512.794824:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826383104:0@lo:39:umount.0 00000400:00000100:3.0:1788448512.794874:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826383104 offset 0 length 224: 4 00000100:00100000:0.0:1788448512.795093:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826382720:0@lo:400:kworker.0 00010000:00010000:0.0:1788448513.022182:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448514.049130:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448514.687220:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448514.687229:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448514.687232:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448514.687235:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448514.687400:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448514.687418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826383232:0@lo:400:kworker.0 00000400:00000100:3.0:1788448514.687469:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826383232 offset 0 length 224: 4 00000001:00100000:0.0:1788448514.754995:0:9511:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788448514.755012:0:9511:0:(genops.c:885:class_export_put()) final put ffff9fc1bb4c5800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788448514.755107:0:8427:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788448514.755112:0:8427:0:(genops.c:885:class_export_put()) final put ffff9fc1bf722000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788448514.756068:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb4c5800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788448514.756144:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf722000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788448514.756165:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bb74a800 for lustre-OST0001 00000020:00000080:1.0:1788448514.756169:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1bf724000 for lustre-OST0000 00010000:00010000:2.0:1788448515.070312:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448516.094173:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448517.118094:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448518.144322:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448518.974089:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448508/real 1788448508] req@ffff9fc0835d1f80 x1875323826382464/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448518.974139:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc0835d1f80 x1875323826382464/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448518.974158:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448518.974182:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788448518.974186:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826382464:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:1.0:1788448518.974438:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788448518.974443:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1788448518.974446:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448518.974451:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 426 00000100:00080000:1.0:1788448518.974456:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.121@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448518.974471:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc183e92800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448518.974500:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083689880 x1875323826383360/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448518.974523:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788448518.974527:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448518.974617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826383360:0@lo:250:kworker.0 00000400:00000100:3.0:1788448518.974657:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323826383360 offset 0 length 520: 4 00000100:00100000:0.0:1788448518.974831:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826383488:0@lo:400:kworker.0 00000400:00000100:0.0:1788448518.974856:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826383488 offset 0 length 224: 4 00010000:00010000:2.0:1788448519.169570:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448520.190106:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448521.214593:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448522.045995:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448512/real 1788448512] req@ffff9fc1bf7c9880 x1875323826383104/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448522 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448522.046025:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1bf7c9880 x1875323826383104/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448522 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448522.046045:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc081ac1000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788448522.046111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826383104:0@lo:39:umount.0 00000100:00080000:2.0:1788448522.048915:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788448522.048923:0:15557:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448522.048931:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788448522.050272:0:15557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050304:0:15557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050311:0:15557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050317:0:15557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050400:0:15557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448522.050407:0:15557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050414:0:15557:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050420:0:15557:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448522.050426:0:15557:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051436:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448522.051447:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051471:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448522.051475:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051485:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448522.051492:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448522.051499:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448522.051501:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788448522.051523:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:1.0:1788448522.051527:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051535:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9800/0xf45a9e4e6b803739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803740 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051552:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448522.051556:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051562:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9000 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448522.051565:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051572:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448522.051584:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448522.051589:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788448522.051592:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788448522.051596:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:1.0:1788448522.051599:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448522.051606:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448522.051608:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448522.051610:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448522.051826:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448522.051847:0:15557:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788448522.051854:0:15557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9000/0xf45a9e4e6b8039bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b8039c4 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448522.051876:0:15557:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788448522.051960:0:15557:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788448522.051963:0:15557:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788448522.051999:0:15557:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788448522.052004:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788448522.052009:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448522.052014:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788448522.052089:0:15557:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fc1bb798000) has no exports 00000020:00080000:2.0:1788448522.052115:0:15557:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9fc1bb798000) has no exports 00000020:01000000:2.0:1788448522.054841:0:15557:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc083122ae0 - data ffff9fc081cb86c0/ffff9fc083439000 00000020:01000000:3.0:1788448522.055176:0:15557:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1bb5cc660 - data ffff9fc1ada0b510/ffff9fc1bb719800 00100000:10000000:3.0:1788448522.064763:0:15557:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788448522.079163:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b80348b 00000020:00000080:1.0:1788448522.079173:0:15557:0:(genops.c:885:class_export_put()) final put ffff9fc081ac4000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788448522.079187:0:15557:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1ba23b000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788448522.079190:0:15557:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1ba23b000 2 00000020:01000004:1.0:1788448522.079193:0:15557:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc1ba23b000 from lustre-OST0000 00000020:00000080:1.0:1788448522.079213:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448522.079222:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788448522.079224:0:15557:0:(genops.c:885:class_export_put()) final put ffff9fc081ac3800/lustre-OST0000_UUID 00000020:00000080:1.0:1788448522.079226:0:15557:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac3800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788448522.079232:0:15557:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788448522.079283:0:15557:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788448522.079286:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788448522.079289:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448522.079293:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788448522.079300:0:15557:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9fc1b738f800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448522.079306:0:15557:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9fc1b5d5cd28) has exports, disconnecting them 00000020:00080000:1.0:1788448522.079318:0:15557:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9fc1b738f800), last request at 1788448281 00000020:00000080:1.0:1788448522.079321:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8034b5 00000020:00080000:1.0:1788448522.079330:0:15557:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc1b738f800): rc 0 00000020:00000080:1.0:1788448522.079334:0:15557:0:(genops.c:885:class_export_put()) final put ffff9fc1b738f800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788448522.079641:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac4000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788448522.079655:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b738f800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788448522.085642:0:15557:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788448522.085649:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448522.085653:0:15557:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788448522.085766:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448522.085956:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448522.085964:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788448522.085969:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788448522.085973:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448522.085977:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788448522.085983:0:15557:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9fc081ac7800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448522.085989:0:15557:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9fc1bb79b370) has exports, disconnecting them 00000020:00080000:1.0:1788448522.085993:0:15557:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9fc081ac7800), last request at 1788448281 00000020:00000080:1.0:1788448522.085997:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8034ca 00000020:00080000:1.0:1788448522.086008:0:15557:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc081ac7800): rc 0 00000020:00000080:1.0:1788448522.086012:0:15557:0:(genops.c:885:class_export_put()) final put ffff9fc081ac7800/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788448522.086203:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc1b59e9000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788448522.086211:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc1ba27f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788448522.086213:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba27f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788448522.086221:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788448522.086295:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac7800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788448522.138292:0:15557:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788448522.138301:0:15557:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788448522.138305:0:15557:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788448522.138313:0:15557:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448522.138500:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448522.138510:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788448522.138516:0:15557:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1ba23b000 1 00000020:00000080:1.0:1788448522.138522:0:15557:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803453 00000020:00000080:1.0:1788448522.138530:0:15557:0:(genops.c:885:class_export_put()) final put ffff9fc1bb4c0800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788448522.138535:0:15557:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788448522.138549:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448522.138554:0:15557:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788448522.138558:0:15557:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9fc1bb79cd28) has no exports 00000020:00000080:2.0:1788448522.138847:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc081ac1000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788448522.138864:0:36:0:(genops.c:885:class_export_put()) final put ffff9fc081ac3000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788448522.138867:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac3000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788448522.138878:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788448522.138959:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bb4c0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788448522.181807:0:15557:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448522.181820:0:15557:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788448522.181825:0:15557:0:(genops.c:885:class_export_put()) final put ffff9fc1ba23e800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788448522.181829:0:15557:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba23e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788448522.181840:0:15557:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788448522.184191:0:15557:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc1ba23f000 00000020:02000400:2.0:1788448522.184242:0:15557:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788448522.249587:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448523.262133:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448524.286417:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448524.479458:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448524.479472:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448524.479476:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448524.479480:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448524.479590:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826383616:0@lo:400:kworker.0 00000400:00000100:2.0:1788448524.479662:0:3648:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826383616 offset 0 length 224: 4 00010000:00010000:1.0:1788448525.313422:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448525.743829:0:15759:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788448525.762703:0:15759:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788448525.762816:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448525.762834:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448525.762853:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448525.762860:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448525.762990:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788448525.762998:0:15759:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788448525.763028:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448525.763044:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137d500 x1875323826382848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448525.763066:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788448525.763073:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788448525.763080:0:15759:0:(import.c:65:import_set_state_nolock()) ffff9fc0831cf000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788448525.763085:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448525.763088:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137d500 x1875323826382848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788448530 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448525.763094:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788448525.763098:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1788448525.763169:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826382848:0@lo:38:kworker.0 00000100:00080000:0.0:1788448525.764198:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788448525.764211:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137ce00 x1875323826382976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448526 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448525.764241:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137f100 x1875323826383232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448525.764253:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc083688000 x1875323826383488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448534 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448525.764264:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc19137d880 x1875323826383616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448525.764274:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788448525.764278:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788448525.764308:0:15759:0:(import.c:65:import_set_state_nolock()) ffff9fc0831ce000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448525.764420:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826383232:0@lo:400:kworker.0 00000100:00100000:3.0:1788448525.764457:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826383488:0@lo:400:kworker.0 00000100:00100000:3.0:1788448525.764480:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826383744:0@lo:39:umount.0 00000400:00000100:3.0:1788448525.764548:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323826383744 offset 0 length 224: 4 00000100:00100000:2.0:1788448525.764844:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826382976:0@lo:400:kworker.0 00000100:00100000:2.0:1788448525.764921:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826383616:0@lo:400:kworker.0 00010000:00010000:1.0:1788448525.765123:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448525.765133:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448525.765145:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448525.765150:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448525.765161:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448525.765169:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448525.765175:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448525.765179:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788448525.765182:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788448525.765200:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:1.0:1788448525.765204:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448525.765210:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b80370f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803716 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448525.765765:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448525.765779:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448525.765781:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448526.335903:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448527.358085:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448528.382597:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448529.406222:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448529.600352:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448529.600363:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788448530.430386:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448531.454517:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448532.478316:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448533.502094:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448533.952221:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448518/real 1788448518] req@ffff9fc083689880 x1875323826383360/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448533 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448533.952254:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083689880 x1875323826383360/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448533 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448533.952274:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448533.952299:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788448533.952303:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826383360:0@lo:250:kworker.0 00000100:00080000:2.0:1788448533.952489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448533.952494:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788448533.952497:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448533.952501:0:37:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 436 00000100:00080000:2.0:1788448533.952506:0:37:0:(import.c:589:import_select_connection()) MGC192.168.206.121@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788448533.952512:0:37:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc183e92800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448533.952542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf7cad80 x1875323826383872/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448533.952619:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826383872:0@lo:250:kworker.0 00000400:00000100:3.0:1788448533.952660:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323826383872 offset 0 length 520: 4 00010000:00010000:0.0:1788448534.526356:0:9523:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448535.550023:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448535.998058:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448525/real 1788448525] req@ffff9fc19137fb80 x1875323826383744/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448535.998214:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc19137fb80 x1875323826383744/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448535.998233:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0831ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788448535.998364:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826383744:0@lo:39:umount.0 00000100:00080000:0.0:1788448536.003453:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788448536.003460:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788448536.003468:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788448536.004401:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004415:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004423:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004430:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004458:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448536.004465:0:15759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004472:0:15759:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004478:0:15759:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004500:0:15759:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004516:0:15759:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788448536.004521:0:15759:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788448536.004546:0:15759:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788448536.004550:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1788448536.004565:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448536.004570:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004577:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc181680800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448536.004581:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004589:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448536.004595:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448536.004600:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448536.004603:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788448536.004605:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788448536.004617:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:0.0:1788448536.004621:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004626:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc181680800/0xf45a9e4e6b80371d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803724 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004648:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448536.004651:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004656:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f400 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448536.004659:0:6505:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004665:0:6505:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448536.004672:0:6505:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448536.004677:0:6505:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788448536.004679:0:6505:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788448536.004680:0:6505:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788448536.004686:0:6505:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:0.0:1788448536.004689:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004694:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351f400/0xf45a9e4e6b8039af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b8039b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.004705:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448536.004707:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448536.004709:0:6505:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448536.004720:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448536.004726:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788448536.004735:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9fc0823d3370) has no exports 00000020:00080000:0.0:1788448536.004757:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9fc0823d3370) has no exports 00010000:00010000:3.0:1788448536.007189:0:9522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788448536.012805:0:15759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc1b5ae5120 - data ffff9fc1adb1d510/ffff9fc083562400 00000020:01000000:0.0:1788448536.013053:0:15759:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9fc0826f0960 - data ffff9fc081c14360/ffff9fc1bb48f800 00100000:10000000:0.0:1788448536.025838:0:15759:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788448536.040263:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8035b1 00000020:00000080:2.0:1788448536.040275:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc082764800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788448536.040342:0:15759:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bf749000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788448536.040346:0:15759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bf749000 2 00000020:01000004:2.0:1788448536.040349:0:15759:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9fc1bf749000 from lustre-OST0001 00000020:00000080:2.0:1788448536.040378:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448536.040387:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788448536.040552:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc082764000/lustre-OST0001_UUID 00000020:00000080:2.0:1788448536.040557:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082764000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788448536.040564:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788448536.040695:0:15759:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb->MGS 00010000:00010000:2.0:1788448536.040710:0:15759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1c204aa00/0xf45a9e4e6b80330a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448536.040835:0:15759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1c204aa00/0xf45a9e4e6b80330a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448536.040842:0:15759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788448536.040845:0:15759:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788448536.040856:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788448536.040869:0:15759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:2.0:1788448536.040873:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1c204aa00/0xf45a9e4e6b80330a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803311 expref: -99 pid: 7447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.040951:0:15759:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448536.040959:0:15759:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448536.040964:0:15759:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448536.040967:0:15759:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788448536.040968:0:15759:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788448536.040978:0:15759:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9fc183e92800 00010000:00010000:2.0:1788448536.040981:0:15759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b80377f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf45a9e4e6b803786 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788448536.040996:0:15759:0:(import.c:65:import_set_state_nolock()) ffff9fc183e92800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788448536.041000:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788448536.041002:0:15759:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788448536.041004:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788448536.041008:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788448536.041018:0:15759:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9fc1bf7cad80 x1875323826383872/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788448553 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788448536.041077:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788448536.041081:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000020:00000080:0.0:1788448536.041148:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc082764800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788448536.041198:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7c63b88e-7c0d-40d0-a31b-5bfffe0befbb:3644:1875323826383872:0@lo:250:kworker.0 10000000:01000000:2.0:1788448536.041262:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788448536.041269:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803207 00000020:00000080:2.0:1788448536.041274:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc19ea20000/7c63b88e-7c0d-40d0-a31b-5bfffe0befbb 00000020:01000000:2.0:1788448536.041288:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.121@tcp (flags='') 00000020:00000080:2.0:1788448536.041293:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448536.041304:0:15759:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.121@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788448536.041308:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9fc19ebe99b8) has no exports 00000020:00000080:0.0:1788448536.041359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc19ea20000/7c63b88e-7c0d-40d0-a31b-5bfffe0befbb for MGC192.168.206.121@tcp 10000000:01000000:0.0:1788448536.041378:0:6514:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788448536.041642:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.121@tcp: client import never connected 00000100:00080000:2.0:1788448536.041646:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788448536.041648:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788448536.041650:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788448536.041651:0:15759:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788448536.041693:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448536.041698:0:15759:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.121@tcp (uuid 7c63b88e-7c0d-40d0-a31b-5bfffe0befbb) 00000020:01000000:2.0:1788448536.041703:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788448536.041706:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448536.041709:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788448536.041714:0:15759:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9fc0831cc800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448536.041749:0:15759:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9fc1bb5399b8) has exports, disconnecting them 00000020:00080000:2.0:1788448536.041754:0:15759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9fc0831cc800), last request at 1788448303 00000020:00000080:2.0:1788448536.041758:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8035db 00000020:00080000:2.0:1788448536.041769:0:15759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc0831cc800): rc 0 00000020:00000080:2.0:1788448536.041772:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc0831cc800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788448536.042113:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cc800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788448536.044201:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788448536.044214:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788448536.044218:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788448536.044225:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788448536.044387:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448536.044407:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788448536.044412:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788448536.044416:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448536.044420:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788448536.044426:0:15759:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9fc081ac0800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788448536.044432:0:15759:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9fc1bb53cd28) has exports, disconnecting them 00000020:00080000:3.0:1788448536.044436:0:15759:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9fc081ac0800), last request at 1788448303 00000020:00000080:3.0:1788448536.044440:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b8035f0 00000020:00080000:3.0:1788448536.044733:0:15759:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9fc081ac0800): rc 0 00000020:00000080:3.0:1788448536.044738:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc081ac0800/lustre-MDT0001-lwp-OST0001 00000020:00000080:0.0:1788448536.045131:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc183e92800 for MGC192.168.206.121@tcp 00000020:00000080:0.0:1788448536.045139:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc183e93800/7c63b88e-7c0d-40d0-a31b-5bfffe0befbb 00000020:00000080:0.0:1788448536.045142:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc183e93800/7c63b88e-7c0d-40d0-a31b-5bfffe0befbb for MGC192.168.206.121@tcp 00000020:01000000:0.0:1788448536.045148:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.121@tcp (7c63b88e-7c0d-40d0-a31b-5bfffe0befbb) 00000020:00000080:0.0:1788448536.045356:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0831cf000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788448536.045361:0:37:0:(genops.c:885:class_export_put()) final put ffff9fc0831c8000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788448536.045364:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831c8000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788448536.045368:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788448536.045411:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc081ac0800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:0.0:1788448536.055018:0:15759:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788448536.055025:0:15759:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788448536.055029:0:15759:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788448536.055036:0:15759:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788448536.055067:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9fc0831ce000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788448536.055112:0:9523:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788448536.110240:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788448536.110390:0:6505:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1788448536.110598:0:9522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:3.0:1788448536.112544:0:6500:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9fc18314da00:6500] 0 exiting: rc = 1 00000100:00100000:3.0:1788448536.123187:0:9521:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9fc082744a00:9521] 2 exiting: rc = 0 00000100:00100000:3.0:1788448536.123543:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9fc18314ca00:6501] 1 exiting: rc = 0 00000100:00100000:0.0:1788448536.123619:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.124010:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9fc1ae8a5c00:6503] 1 exiting: rc = 0 00000100:00100000:3.0:1788448536.124087:0:13187:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9fc1bb535e00:13187] 3 exiting: rc = 0 00000100:00100000:2.0:1788448536.124094:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9fc1aeb2ac00:6504] 2 exiting: rc = 0 00000100:00100000:1.0:1788448536.124209:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9fc18549fc00:6502] 0 exiting: rc = 1 00000100:00100000:0.0:1788448536.124533:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124545:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124552:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124559:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124568:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124589:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124596:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124602:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124607:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124620:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124627:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124665:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124672:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124680:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124691:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124697:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124703:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124709:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124714:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124721:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124728:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124765:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124771:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124778:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124794:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124800:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124806:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124814:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124823:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124829:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124834:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124839:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124845:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124850:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.124995:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125002:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125012:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125021:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125027:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125058:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125065:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125071:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125077:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125084:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125090:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125099:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125105:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125114:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125119:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125123:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125128:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125133:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125138:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125143:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125148:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125154:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125159:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125164:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125169:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125174:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125179:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125184:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125188:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448536.125193:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788448536.126674:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448536.126688:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:0.0:1788448536.126693:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc0831cb800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:0.0:1788448536.126697:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc0831cb800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:0.0:1788448536.126703:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:0.0:1788448536.126802:0:15759:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bf749000 1 00000020:00000080:0.0:1788448536.126808:0:15759:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xf45a9e4e6b803580 00000020:00000080:0.0:1788448536.126841:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc1b5c9a800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1788448536.126860:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1788448536.126864:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448536.126873:0:15759:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448536.126877:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9fc0823d0000) has no exports 00000020:00000080:2.0:1788448536.126911:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1b5c9a800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788448536.182246:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448536.182259:0:15759:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788448536.182265:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc1bf74f800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788448536.182269:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1bf74f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788448536.182275:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788448536.182777:0:15759:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9fc1bf748000 00000020:01000000:0.0:1788448536.182810:0:15759:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788448536.182815:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448536.182820:0:15759:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788448536.182824:0:15759:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9fc1b5d599b8) has no exports 00000020:00000080:0.0:1788448536.182858:0:15759:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448536.182864:0:15759:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788448536.182867:0:15759:0:(genops.c:885:class_export_put()) final put ffff9fc1ba278000/OSS_uuid 00000020:00000080:0.0:1788448536.182870:0:15759:0:(genops.c:844:class_export_destroy()) destroying export ffff9fc1ba278000/OSS_uuid for OSS 00000020:01000000:0.0:1788448536.182874:0:15759:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788448536.183238:0:6513:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788448536.183299:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9fc1b483a000:8433] 1 exiting: rc = 0 00000100:00100000:0.0:1788448536.184832:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9fc1b5a16400:8431] 0 exiting: rc = 1 00000100:00100000:1.0:1788448536.184941:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9fc1b5a0ee00:8434] 2 exiting: rc = 0 00000100:00100000:1.0:1788448536.194766:0:8539:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9fc1ba252e00:8539] 3 exiting: rc = 0 00000100:00100000:3.0:1788448536.194992:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195001:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195007:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195014:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195019:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195025:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195030:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195034:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195039:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195045:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195049:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195054:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195059:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195064:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195081:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195086:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195091:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195102:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195107:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195111:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195116:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195121:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195126:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195131:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195136:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195141:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195146:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195155:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195160:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195165:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195170:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195175:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195180:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195185:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195190:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195196:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195201:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195206:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195215:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195220:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195225:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195230:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195235:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195239:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195244:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195249:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195253:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195259:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195264:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195276:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195282:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195287:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195291:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195296:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195301:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195306:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195312:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195317:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195322:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195327:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195338:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195345:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195351:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.195356:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.199486:0:11085:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9fc083423000:11085] 2 exiting: rc = 0 00000100:00100000:2.0:1788448536.203589:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9fc19175a800:8436] 1 exiting: rc = 0 00000100:00100000:3.0:1788448536.209092:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9fc1b5a0fc00:8435] 0 exiting: rc = 1 00000100:00100000:1.0:1788448536.209865:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209874:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209894:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209900:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209905:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209911:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209915:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209920:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209926:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209931:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209935:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209940:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209945:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209950:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209955:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209960:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209965:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209970:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209975:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209980:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209986:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209991:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.209996:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210001:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210006:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210011:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210017:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210022:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210042:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210046:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210051:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210057:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210062:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210067:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210072:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210077:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210105:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210111:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210116:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210121:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210127:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210132:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210137:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210142:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210146:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210151:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210156:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210161:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210166:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210171:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210191:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210197:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210203:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210208:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210213:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210218:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210223:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210228:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210234:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210239:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210244:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210249:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210254:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.210267:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.211161:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9fc1ba249800:8437] 0 exiting: rc = 1 00000100:00100000:1.0:1788448536.211361:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9fc1aeb2b800:8438] 1 exiting: rc = 0 00000100:00100000:0.0:1788448536.211861:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9fc1aeb2ba00:8439] 2 exiting: rc = 0 00000100:00100000:1.0:1788448536.214407:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214416:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214421:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214426:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214432:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214437:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214454:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214460:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214465:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214471:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214478:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214483:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214489:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214494:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214499:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214505:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214510:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214515:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214538:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214544:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214549:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214554:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214559:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214564:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214569:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214574:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214579:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214585:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214590:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214595:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214600:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214606:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214624:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214629:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214635:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214640:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214645:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214650:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214796:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214804:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214809:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214814:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214833:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214839:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214854:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214860:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214866:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214872:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214877:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214902:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214907:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214913:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214918:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214923:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214928:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214933:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214939:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214944:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214949:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214965:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214972:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214986:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.214999:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.215013:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.223630:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9fc1b48dca00:8440] 0 exiting: rc = 1 00000100:00100000:0.0:1788448536.225089:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9fc1bb4ab200:8441] 1 exiting: rc = 0 00000100:00100000:1.0:1788448536.225156:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225164:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225169:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225187:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225192:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225197:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225203:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225208:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225213:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225218:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225223:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225228:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225233:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225239:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225252:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225260:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225265:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225270:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225275:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225280:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225285:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225289:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225294:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225299:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225304:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225309:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225314:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225319:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225323:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225327:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225333:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225339:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225343:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225348:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225353:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225358:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225362:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225367:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225380:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225385:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225390:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225395:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225400:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225405:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225409:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225414:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225419:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225424:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225429:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225433:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225438:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225458:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225464:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225469:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225474:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225479:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225484:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225489:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225494:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225499:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225504:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225510:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225516:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448536.225521:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448536.227272:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9fc187e25000:8443] 1 exiting: rc = 0 00000100:00100000:0.0:1788448536.227512:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9fc1bb4aa200:8442] 0 exiting: rc = 1 00000100:00100000:2.0:1788448536.227600:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227609:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227625:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227633:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227639:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227645:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227652:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227669:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227676:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227693:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227698:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227721:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227728:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227734:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227740:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227748:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227754:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227761:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227768:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227774:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227790:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227798:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227804:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227828:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227836:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227841:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227847:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227853:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227860:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227867:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227876:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227912:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227919:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227925:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227932:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227955:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227963:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227969:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227975:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227981:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227987:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227993:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.227999:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228005:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228019:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228026:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228032:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228053:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228059:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228064:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228070:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228076:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228082:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228088:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228094:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228101:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228106:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228111:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228116:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228135:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228142:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228148:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228153:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448536.228168:0:15759:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788448536.236441:0:15759:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788448553.720705:0:16525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788448564.776424:0:17124:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788448564.776431:0:17124:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788448564.776432:0:17124:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788448564.778688:0:17124:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc083f6b800 00000020:01000004:1.0:1788448564.778708:0:17124:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788448564.778715:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788448564.778729:0:17124:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9fc1bb798000) 00000020:00000080:1.0:1788448564.778741:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448564.833838:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788448564.834969:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788448564.838785:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.840668:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.840861:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788448564.842124:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.842507:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.843020:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.843275:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788448564.843576:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788448564.843916:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788448564.844146:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.848330:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788448564.852087:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788448564.852679:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788448564.853256:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.853704:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.854914:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.855240:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.855535:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.855901:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.856222:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.856679:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.857460:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.857765:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.858142:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.858631:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.859689:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.860008:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.863351:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.864409:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.864989:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.865243:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.865561:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788448564.865942:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.866170:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.866464:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.867006:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788448564.867244:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788448564.869430:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788448564.870024:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788448564.872949:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1788448564.873910:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788448564.874869:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788448564.875397:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788448564.876586:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788448564.876965:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1788448564.880618:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788448564.881209:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788448564.881531:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788448564.882787:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788448564.883057:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788448564.883241:0:17124:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:01000000:1.0:1788448564.884560:0:17124:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788448564.884801:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788448564.884810:0:17124:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788448564.884822:0:17124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8047c4 00000020:01000004:1.0:1788448564.884830:0:17124:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788448564.884835:0:17124:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788448564.884840:0:17124:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc083f6b800 from MGS 00000020:01000004:1.0:1788448564.884843:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788448564.884853:0:17124:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9fc1bb7999b8) 00000020:00000080:1.0:1788448564.884862:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788448564.884946:0:17124:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc083f6b800 from MGS, refs=2 00080000:01000000:1.0:1788448564.884951:0:17124:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788448564.884955:0:17124:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b8047d2 00000100:00100000:1.0:1788448564.885053:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788448564.885185:0:17124:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788448564.885191:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788448564.888054:0:17124:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788448564.888074:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788448564.888742:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448564.888952:0:17124:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788448564.888958:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788448564.889805:0:17124:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788448564.889814:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788448564.890165:0:17124:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788448564.890172:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788448564.890871:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.890874:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.890876:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.891165:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.891167:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.891169:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448564.892290:0:17124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00000040:01000000:0.0:1788448564.903976:0:17124:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788448564.906631:0:17136:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 00010000:00010000:1.0:1788448564.906853:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:0.0:1788448564.909652:0:17124:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788448564.909718:0:17124:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788448564.911470:0:17124:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788448564.911794:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448564.911981:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788448564.911986:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788448564.912850:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788448564.912859:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788448564.913300:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788448564.913307:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788448564.914353:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788448564.914373:0:17124:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.121@tcp' 00000020:01000004:0.0:1788448564.914375:0:17124:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788448564.914405:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.121@tcp (typ=mgc) 00000020:00000080:0.0:1788448564.914417:0:17124:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.121@tcp (ffff9fc1bb53cd28) 00000020:00000080:0.0:1788448564.914432:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788448564.914525:0:17124:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc184e54000@MGC192.168.206.121@tcp: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448564.914693:0:17124:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.121@tcp-0 is initialized 00000040:01000000:0.0:1788448564.914700:0:17124:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788448564.916877:0:17141:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788448564.921907:0:17142:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788448564.923108:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.121@tcp (uuid 943bfcb5-816e-4cdd-a66b-4e69884ef502) 00000020:00000080:1.0:1788448564.923130:0:17124:0:(genops.c:1385:class_connect()) connect: client 943bfcb5-816e-4cdd-a66b-4e69884ef502, cookie 0xf45a9e4e6b8047e0 00000100:00080000:1.0:1788448564.923141:0:17124:0:(import.c:510:import_select_connection()) MGC192.168.206.121@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448564.923147:0:17124:0:(import.c:624:import_select_connection()) MGC192.168.206.121@tcp: import ffff9fc184e54000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448564.923176:0:17124:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083688e00 x1875323826384000/t0(0) o250->MGC192.168.206.121@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448564.923209:0:17124:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 943bfcb5-816e-4cdd-a66b-4e69884ef502->MGS 00000020:01000004:1.0:1788448564.923229:0:17124:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788448564.923234:0:17124:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788448564.923247:0:17124:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9fc1bb79cd28) 00000020:00000080:1.0:1788448564.923258:0:17124:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788448564.923317:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943bfcb5-816e-4cdd-a66b-4e69884ef502:3644:1875323826384000:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788448564.923378:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448564.923723:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384000 00000100:00100000:0.0:1788448564.923733:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384000 00000100:00100000:0.0:1788448564.924023:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448564.924035:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1875323826384000:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788448564.924061:0:17138:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 943bfcb5-816e-4cdd-a66b-4e69884ef502@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:0.0:1788448564.924085:0:17138:0:(genops.c:1385:class_connect()) connect: client 943bfcb5-816e-4cdd-a66b-4e69884ef502, cookie 0xf45a9e4e6b8047ee 00000100:00080000:0.0:1788448564.924232:0:17138:0:(import.c:65:import_set_state_nolock()) ffff9fc184e53800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448564.924318:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+5:3644:x1875323826384000:12345-0@lo:250:mount.lustre.0 Request processed in 283us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448564.928987:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448564.929075:0:3644:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.121@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788448564.929086:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.121@tcp: connect to target with instance 0 00000100:00080000:0.0:1788448564.929095:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.121@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788448564.929100:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788448564.929104:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc184e54000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788448564.929107:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788448564.929155:0:3644:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788448564.929170:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:943bfcb5-816e-4cdd-a66b-4e69884ef502:3644:1875323826384000:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788448564.942820:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448564.943190:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788448564.943250:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788448564.947972:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448564.947984:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788448564.955171:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448564.955184:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788448564.956038:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448564.956224:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788448564.956229:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788448564.957020:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788448564.957028:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788448565.026280:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448565.026708:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788448565.026715:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788448565.029993:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788448565.030007:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788448565.031006:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448565.031178:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448565.031183:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788448565.031860:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448565.031867:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788448565.032481:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448565.032761:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448565.032766:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788448565.035772:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448565.035792:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788448565.036871:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448565.037715:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448565.037721:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788448565.039774:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788448565.039784:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788448565.108718:0:17124:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448565.109003:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788448565.109010:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788448565.110683:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788448565.110696:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788448565.116260:0:17124:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788448565.116274:0:17124:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788448565.117315:0:17124:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788448565.117343:0:17124:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788448565.117349:0:17124:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788448565.117441:0:17124:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788448565.117478:0:17124:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788448565.117483:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788448565.117484:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448565.117486:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448565.117487:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448565.117488:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448565.117489:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448565.117491:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448565.117492:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448565.117494:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448565.117495:0:17124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448565.117968:0:17124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788448565.117973:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448565.117974:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448565.117975:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448565.117976:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448565.117977:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448565.117979:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448565.117980:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448565.117981:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448565.117982:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448565.117983:0:17124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448565.118012:0:17124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788448565.118032:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384128:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448565.118110:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.118208:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc191c7b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448565.118642:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384128 00000100:00100000:3.0:1788448565.118650:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384128 00000100:00100000:3.0:1788448565.118847:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448565.118860:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+5:17124:x1875323826384128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788448565.119118:0:17140:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788448565.119121:0:17140:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788448565.119125:0:17140:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788448565.119786:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788448565.120619:0:17140:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:3.0:1788448565.122249:0:17162:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788448565.122257:0:17162:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:3.0:1788448565.122260:0:17162:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788448565.122262:0:17162:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788448565.122603:0:17162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788448565.122838:0:17140:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788448565.122850:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788448565.124605:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+5:17124:x1875323826384128:12345-0@lo:253:mount.lustre.0 Request processed in 5740us (6487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448565.124631:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448565.124761:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384128:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448565.124776:0:17124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788448565.124779:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448565.124781:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448565.124782:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448565.124783:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448565.124784:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448565.124785:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448565.124787:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448565.124788:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448565.124790:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448565.124791:0:17124:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788448565.124809:0:17124:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc083f6b800 from lustre-MDT0000 10000000:01000000:0.0:1788448565.124839:0:17124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788448565.124842:0:17124:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788448565.124846:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9fc1bb53cd28 10000000:01000000:0.0:1788448565.124850:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448565.124857:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9fc1bb53cd28 from 1 10000000:01000000:0.0:1788448565.124860:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788448565.124908:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.124918:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.124928:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448565.124947:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384256:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448565.124982:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.125035:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc191c7b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448565.125138:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384256 00000100:00100000:1.0:1788448565.125150:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384256 00000100:00100000:1.0:1788448565.125190:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448565.125198:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+5:17124:x1875323826384256:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448565.125211:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448565.125225:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fce00/0xf45a9e4e6b8047fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8047f5 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448565.125245:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fce00/0xf45a9e4e6b8047fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8047f5 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448565.125256:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fce00/0xf45a9e4e6b8047fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8047f5 expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448565.125265:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fce00, rc 0) 00000100:00100000:1.0:1788448565.125449:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+6:17124:x1875323826384256:12345-0@lo:101:mount.lustre.0 Request processed in 251us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448565.125456:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448565.125680:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384256:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448565.125693:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.125713:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.125764:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384384:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448565.125791:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.125851:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448565.125907:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384384 00000100:00100000:1.0:1788448565.125911:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384384 00000100:00100000:1.0:1788448565.125972:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448565.125980:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+6:17124:x1875323826384384:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448565.126050:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+6:17124:x1875323826384384:12345-0@lo:501:mount.lustre.0 Request processed in 71us (258us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448565.126057:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448565.126111:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384384:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448565.126140:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788448565.126154:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126163:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448565.126171:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc083f6b800 10000000:01000000:2.0:1788448565.126176:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448565.126180:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc083f6b800 10000000:01000000:2.0:1788448565.126183:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788448565.126186:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc083f6b800 from 1 10000000:01000000:2.0:1788448565.126188:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788448565.126206:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126214:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126223:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.126241:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448565.126264:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.126491:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.126593:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384512 00000100:00100000:0.0:1788448565.126598:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384512 00000100:00100000:0.0:1788448565.126619:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448565.126639:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+6:17124:x1875323826384512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448565.126648:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448565.126660:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b80480a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804803 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.126677:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b80480a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804803 expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.126686:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351f600/0xf45a9e4e6b80480a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804803 expref: 7 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.126695:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f600, rc 0) 00000100:00100000:0.0:1788448565.126732:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+7:17124:x1875323826384512:12345-0@lo:101:mount.lustre.0 Request processed in 94us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.126739:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448565.126863:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448565.126874:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126900:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448565.126913:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788448565.126929:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126937:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331600/0xf45a9e4e6b804803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80480a expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448565.126943:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788448565.126947:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448565.126951:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc083f6b800 10000000:01000000:2.0:1788448565.126954:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788448565.126957:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788448565.126960:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448565.126972:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126980:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.126995:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.127008:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448565.127031:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.127042:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.127099:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384640 00000100:00100000:0.0:1788448565.127103:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384640 00000100:00100000:0.0:1788448565.127120:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448565.127125:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+7:17124:x1875323826384640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448565.127132:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448565.127139:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351f000/0xf45a9e4e6b804818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804811 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.127153:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351f000/0xf45a9e4e6b804818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804811 expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.127172:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351f000/0xf45a9e4e6b804818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804811 expref: 8 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.127179:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f000, rc 0) 00000100:00100000:0.0:1788448565.127212:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+8:17124:x1875323826384640:12345-0@lo:101:mount.lustre.0 Request processed in 86us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.127218:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448565.127282:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448565.127301:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.127310:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.127350:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448565.127372:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.127396:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.127596:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384768 00000100:00100000:0.0:1788448565.127601:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384768 00000100:00100000:0.0:1788448565.127619:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448565.127637:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+8:17124:x1875323826384768:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448565.127767:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17124:x1875323826384768:12345-0@lo:501:mount.lustre.0 Request processed in 131us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.127775:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448565.127851:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384768:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448565.127877:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384896:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448565.127945:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.127956:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.128007:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826384896 00000100:00100000:0.0:1788448565.128014:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826384896 00000100:00100000:0.0:1788448565.128032:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448565.128038:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17124:x1875323826384896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448565.128731:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17124:x1875323826384896:12345-0@lo:503:mount.lustre.0 Request processed in 688us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.128739:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448565.128843:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826384896:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448565.129388:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17163:1875323826385024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448565.129433:0:17163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448565.129675:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184ee3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.129718:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826385024 00000100:00100000:0.0:1788448565.129724:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826385024 00000100:00100000:3.0:1788448565.129797:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448565.129808:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17163:x1875323826385024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448565.130750:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17163:x1875323826385024:12345-0@lo:502:llog_process_th.0 Request processed in 940us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448565.130765:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448565.130850:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17163:1875323826385024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448565.130907:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448565.130917:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448565.130920:0:17163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788448565.130925:0:17163:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788448565.130928:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448565.130941:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9fc19ebe8000) 00000020:00000080:3.0:1788448565.130956:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788448565.130961:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788448565.131040:0:17163:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788448565.131047:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b804826 00000020:00000080:3.0:1788448565.131250:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788448565.131255:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448565.131258:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448565.131265:0:17163:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788448565.131269:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448565.131272:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448565.131274:0:17163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788448565.131277:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448565.131284:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9fc19ebeb370) 00000020:00000080:3.0:1788448565.131306:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788448565.131312:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788448565.131314:0:17163:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788448565.131317:0:17163:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788448565.131323:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788448565.131363:0:17163:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc083f6b800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788448565.131375:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9fc19ebe99b8) 00000020:00000080:3.0:1788448565.131383:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788448565.131426:0:17163:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788448565.131433:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b80483b 00000020:00000080:3.0:1788448565.131641:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788448565.131648:0:17163:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788448565.131655:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf45a9e4e6b804842 00080000:01000000:3.0:1788448565.131660:0:17163:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788448565.131665:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b804849 00010000:00010000:3.0:1788448565.244584:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788448565.245429:0:17163:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788448565.245792:0:17163:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788448565.248430:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9fc19ebecd28) 00000020:00000080:3.0:1788448565.248451:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788448565.248561:0:17163:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788448565.248813:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b804857 00000020:00000080:0.0:1788448565.249978:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788448565.258477:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf45a9e4e6b80485e 00000020:00000080:1.0:1788448565.262113:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788448565.262138:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448565.262145:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448565.262147:0:17163:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788448565.262149:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788448565.262152:0:17163:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788448565.262153:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448565.262155:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448565.262156:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788448565.262159:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448565.262160:0:17163:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788448565.262163:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448565.262167:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448565.262169:0:17163:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788448565.262174:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788448565.262223:0:17163:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788448565.262240:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448565.262243:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448565.262244:0:17163:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788448565.262247:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448565.262250:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448565.262252:0:17163:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788448565.262254:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788448565.262260:0:17163:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:00000080:1.0:1788448565.262288:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448565.262303:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9fc1bb79b370) 00000020:00000080:1.0:1788448565.262321:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788448565.262325:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788448565.262382:0:17163:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788448565.262387:0:17163:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788448565.262394:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b80486c 00010000:00080000:1.0:1788448565.262439:0:17163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1bb74e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448565.266757:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788448565.267521:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788448565.267542:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788448565.267585:0:17163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788448565.267607:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b804873 00000100:00080000:0.0:1788448565.267617:0:17163:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448565.267633:0:17163:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1bb74e800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448565.267673:0:17163:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137dc00 x1875323826385152/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448565.267704:0:17163:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788448565.267760:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.267764:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.267766:0:17163:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788448565.267769:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788448565.267771:0:17163:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1788448565.267773:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448565.267774:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788448565.267776:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788448565.267778:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.267779:0:17163:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788448565.267781:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788448565.267786:0:17163:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788448565.267788:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.267790:0:17163:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788448565.267792:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788448565.267795:0:17163:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:0.0:1788448565.267815:0:17163:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788448565.267818:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448565.267829:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9fc1bb5399b8) 00000020:00000080:0.0:1788448565.267839:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788448565.267842:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788448565.267923:0:17163:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788448565.267929:0:17163:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788448565.267940:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b804881 00010000:00080000:0.0:1788448565.267968:0:17163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc082765000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448565.268152:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:1.0:1788448565.268717:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826385152:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788448565.268828:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.268979:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826385152 00000100:00100000:2.0:1788448565.269001:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826385152 00000100:00100000:2.0:1788448565.269036:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448565.269043:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826385152:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788448565.269058:0:17150:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788448565.269102:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826385152:12345-0@lo:38:llog_process_th.0 Request processed in 57us (273us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788448565.269109:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788448565.269146:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448565.269151:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788448565.269155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826385152:0@lo:38:llog_process_th.0 00000040:01000000:2.0:1788448565.269635:0:17163:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788448565.269920:0:17163:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788448565.273935:0:17163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448565.275744:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788448565.285005:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788448565.289088:0:17169:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788448565.289095:0:17169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788448565.290145:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788448565.290156:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788448565.290190:0:17163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788448565.290218:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b804888 00000100:00080000:2.0:1788448565.290227:0:17163:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448565.290233:0:17163:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc082765000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448565.290275:0:17163:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf7c8e00 x1875323826385280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448565.290302:0:17163:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788448565.290351:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448565.290355:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448565.290357:0:17163:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788448565.290366:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788448565.290369:0:17163:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788448565.290370:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448565.290372:0:17163:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448565.290374:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788448565.290376:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448565.290377:0:17163:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788448565.290380:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448565.290384:0:17163:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788448565.290387:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448565.290388:0:17163:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788448565.290391:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788448565.290394:0:17163:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:2.0:1788448565.290416:0:17163:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788448565.290419:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448565.290430:0:17163:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9fc0823d3370) 00000020:00000080:2.0:1788448565.290440:0:17163:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:2.0:1788448565.290445:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788448565.290495:0:17163:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788448565.290514:0:17163:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:2.0:1788448565.290522:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf45a9e4e6b804896 00010000:00080000:2.0:1788448565.290551:0:17163:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc187ba0800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1788448565.290898:0:17163:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1788448565.290963:0:17163:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788448565.290977:0:17163:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1788448565.291143:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826385280:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788448565.291202:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826385280 offset 0 length 520: 4 00000040:00080000:3.0:1788448565.293533:0:17163:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448565.295188:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788448565.295383:0:17163:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788448565.298258:0:17171:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788448565.298266:0:17171:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788448565.305121:0:17163:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788448565.305137:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788448565.305179:0:17163:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788448565.305263:0:17163:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b80489d 00000100:00080000:0.0:1788448565.305275:0:17163:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448565.305281:0:17163:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc187ba0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448565.305391:0:17163:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137dc00 x1875323826385408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448565.305461:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826385408:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788448565.305642:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826385408 offset 0 length 520: 4 00000100:00080000:0.0:1788448565.305703:0:17163:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788448565.305779:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.305784:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.305786:0:17163:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788448565.305789:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448565.305793:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.305794:0:17163:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448565.305797:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448565.305799:0:17163:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788448565.305802:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.305804:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.305805:0:17163:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788448565.305808:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448565.305810:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.305812:0:17163:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788448565.305816:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788448565.305844:0:17163:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17163:1875323826385536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.305924:0:17163:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.305966:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826385536 00000100:00100000:0.0:1788448565.305973:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826385536 00000100:00100000:0.0:1788448565.306015:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448565.306023:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17163:x1875323826385536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.306124:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17163:x1875323826385536:12345-0@lo:502:llog_process_th.0 Request processed in 100us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.306133:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448565.306170:0:17163:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.306187:0:17163:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17163:1875323826385536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448565.306222:0:17163:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.306226:0:17163:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.306228:0:17163:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788448565.306231:0:17163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788448565.306929:0:17124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788448565.306964:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788448565.306981:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.306993:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331200/0xf45a9e4e6b804811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804818 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448565.307015:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6b800 from 1 10000000:01000000:2.0:1788448565.307019:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448565.307046:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.307055:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.307064:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.307080:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826385664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448565.307115:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.307142:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448565.307334:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826385664 00000100:00100000:3.0:1788448565.307341:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826385664 00000100:00100000:3.0:1788448565.307372:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788448565.307380:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+9:17124:x1875323826385664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448565.307390:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448565.307404:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8048a4 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.307427:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.307438:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.307446:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f800, rc 0) 00000100:00100000:3.0:1788448565.307479:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+10:17124:x1875323826385664:12345-0@lo:101:mount.lustre.0 Request processed in 101us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448565.307485:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448565.308004:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826385664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448565.308020:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.308030:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.308861:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826385792:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788448565.309021:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.309066:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448565.309156:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826385792 00000100:00100000:3.0:1788448565.309162:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826385792 00000100:00100000:3.0:1788448565.309204:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448565.309214:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+10:17124:x1875323826385792:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788448565.309231:0:17139:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788448565.309236:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788448565.309417:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+10:17124:x1875323826385792:12345-0@lo:256:mount.lustre.0 Request processed in 204us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448565.309425:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448565.309665:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826385792:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788448565.311457:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448565.313526:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.313540:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448565.313549:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc083f6b800 from 1 10000000:01000000:2.0:1788448565.313552:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448565.313594:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.313602:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.313612:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.313646:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826385920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448565.313710:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.313759:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826385920 00000100:00100000:2.0:1788448565.313766:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826385920 00000100:00100000:2.0:1788448565.313812:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448565.313821:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+10:17124:x1875323826385920:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448565.313833:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448565.313847:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8048b2 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.313869:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.313915:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.313923:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331c00, rc 0) 00000100:00100000:2.0:1788448565.314180:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17124:x1875323826385920:12345-0@lo:101:mount.lustre.0 Request processed in 133us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448565.314188:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448565.314257:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448565.314275:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826385920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448565.314287:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.314357:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.314413:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448565.314437:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448565.314489:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.315110:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386048 00000100:00100000:0.0:1788448565.315118:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386048 00000100:00100000:0.0:1788448565.315156:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448565.315165:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17124:x1875323826386048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448565.315321:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17124:x1875323826386048:12345-0@lo:501:mount.lustre.0 Request processed in 157us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.315328:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448565.315483:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448565.315546:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448565.315590:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448565.315630:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb435540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448565.315741:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386176 00000100:00100000:1.0:1788448565.315746:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386176 00000100:00100000:1.0:1788448565.315773:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448565.315779:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17124:x1875323826386176:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448565.315902:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17124:x1875323826386176:12345-0@lo:503:mount.lustre.0 Request processed in 101us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448565.315909:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448565.316100:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386176:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448565.316553:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17173:1875323826386304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.316594:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.316630:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386304 00000100:00100000:0.0:1788448565.316635:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386304 00000100:00100000:0.0:1788448565.316661:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448565.316668:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17173:x1875323826386304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.316808:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.317193:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17173:x1875323826386304:12345-0@lo:502:llog_process_th.0 Request processed in 524us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.317207:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448565.317246:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17173:1875323826386304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448565.317268:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448565.317275:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317277:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788448565.317284:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc083f6b800 00000020:00000080:0.0:1788448565.317286:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448565.317303:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.317306:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317307:0:17173:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788448565.317310:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448565.317312:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317313:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788448565.317316:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc083f6b800 00000020:00000080:0.0:1788448565.317318:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448565.317365:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.317368:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317369:0:17173:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788448565.317372:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448565.317374:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317375:0:17173:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448565.317378:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc083f6b800 00000020:00000080:0.0:1788448565.317380:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448565.317394:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.317396:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317397:0:17173:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448565.317399:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448565.317401:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.317403:0:17173:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788448565.317406:0:17173:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc083f6b800 00000020:00000080:0.0:1788448565.317407:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448565.317439:0:17173:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17173:1875323826386432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.317467:0:17173:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.317485:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386432 00000100:00100000:0.0:1788448565.317489:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386432 00000100:00100000:0.0:1788448565.323753:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448565.323773:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17173:x1875323826386432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.323995:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17173:x1875323826386432:12345-0@lo:502:llog_process_th.0 Request processed in 228us (6525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.324004:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448565.324087:0:17173:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.324112:0:17173:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17173:1875323826386432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448565.324150:0:17173:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448565.324158:0:17173:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448565.324160:0:17173:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788448565.324166:0:17173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788448565.325424:0:17124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788448565.325460:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448565.327616:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.327643:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448565.327745:0:17124:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788448565.327749:0:17124:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc083f6b800 10000000:01000000:0.0:1788448565.327751:0:17124:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc083f6b800 10000000:01000000:0.0:1788448565.327756:0:17124:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448565.327762:0:17124:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc083f6b800 from 1 10000000:01000000:0.0:1788448565.328466:0:17124:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448565.328518:0:17124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.328527:0:17124:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.328540:0:17124:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448565.328564:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448565.328638:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.328687:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386560 00000100:00100000:0.0:1788448565.328694:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386560 00000100:00100000:0.0:1788448565.328738:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448565.328747:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17124:x1875323826386560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448565.328760:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448565.328773:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351f800/0xf45a9e4e6b8048c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8048c0 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.328797:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351f800/0xf45a9e4e6b8048c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048c0 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.328808:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351f800/0xf45a9e4e6b8048c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048c0 expref: 12 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.328819:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f800, rc 0) 00000100:00100000:0.0:1788448565.328851:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826386560:12345-0@lo:101:mount.lustre.0 Request processed in 104us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.328858:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448565.328935:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.328970:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386560:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448565.328987:0:17124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.328997:0:17124:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448565.329055:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448565.329077:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.329098:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386688 00000100:00100000:0.0:1788448565.329102:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386688 00000100:00100000:0.0:1788448565.329122:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448565.329128:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826386688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448565.329231:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826386688:12345-0@lo:501:mount.lustre.0 Request processed in 101us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.329238:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448565.329262:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.329272:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386688:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448565.330680:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386816:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448565.330753:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.330799:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386816 00000100:00100000:0.0:1788448565.330806:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386816 00000100:00100000:0.0:1788448565.330849:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448565.330857:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826386816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448565.337940:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.339391:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826386816:12345-0@lo:503:mount.lustre.0 Request processed in 8525us (8629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.339419:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448565.339873:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826386816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448565.340861:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17177:1875323826386944:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.341055:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.341111:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969e8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448565.341140:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826386944 00000100:00100000:1.0:1788448565.341150:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826386944 00000100:00100000:1.0:1788448565.342637:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448565.342657:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17177:x1875323826386944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448565.342841:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17177:x1875323826386944:12345-0@lo:502:llog_process_th.0 Request processed in 189us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448565.342851:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448565.345365:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17177:1875323826386944:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788448565.345852:0:17177:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788448565.345871:0:17177:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9fc1bb538000) 00000020:00000080:0.0:1788448565.345943:0:17177:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:0.0:1788448565.346073:0:17177:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc083f6b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448565.346077:0:17177:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc083f6b800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448565.346080:0:17177:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc083f6b800 4 00010000:00080000:0.0:1788448565.346112:0:17177:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc08360a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.121@tcp at head 00010000:00010000:0.0:1788448565.354119:0:17177:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:0.0:1788448565.355289:0:17177:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788448565.355581:0:17177:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448565.355600:0:17177:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf45a9e4e6b8048d5 00000100:00080000:0.0:1788448565.355614:0:17177:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448565.355630:0:17177:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc08360a800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448565.355669:0:17177:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137fb80 x1875323826387072/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448565.355747:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826387072:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788448565.355835:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788448565.356089:0:17177:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788448565.356713:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17177:1875323826387200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.356796:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.356833:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387200 00000100:00100000:0.0:1788448565.356841:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387200 00000100:00100000:0.0:1788448565.356912:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448565.356922:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17177:x1875323826387200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.357054:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17177:x1875323826387200:12345-0@lo:502:llog_process_th.0 Request processed in 132us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.357062:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448565.357118:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.357141:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17177:1875323826387200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.357199:0:17177:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17177:1875323826387328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448565.357235:0:17177:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.357257:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387328 00000100:00100000:0.0:1788448565.357261:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387328 00000100:00100000:0.0:1788448565.357289:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448565.357295:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17177:x1875323826387328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448565.357367:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387072 00000100:00100000:2.0:1788448565.357373:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387072 00000100:00100000:2.0:1788448565.357397:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448565.357403:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826387072:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448565.357453:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826387072:12345-0@lo:38:llog_process_th.0 Request processed in 49us (1618us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788448565.357459:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448565.357490:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448565.357503:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc08360a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448565.357508:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788448565.357512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826387072:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788448565.357679:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17177:x1875323826387328:12345-0@lo:502:llog_process_th.0 Request processed in 382us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.357686:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448565.357726:0:17177:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.357740:0:17177:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:943bfcb5-816e-4cdd-a66b-4e69884ef502:17177:1875323826387328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788448565.357762:0:17177:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788448565.357830:0:17124:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788448565.357860:0:17124:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448565.357904:0:17124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.357915:0:17124:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351fe00/0xf45a9e4e6b8048c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048c7 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788448565.357967:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788448565.357974:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448565.357976:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448565.357977:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448565.357979:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448565.357980:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448565.357983:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448565.357984:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448565.357986:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448565.357987:0:17124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448565.357992:0:17124:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788448565.357994:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448565.357995:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788448565.357996:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448565.357997:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448565.357998:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448565.357999:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448565.358000:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788448565.358001:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788448565.358003:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448565.358004:0:17124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448565.358019:0:17124:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788448565.358030:0:17124:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826387456:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448565.358070:0:17124:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.358094:0:17124:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1916e8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.358118:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387456 00000100:00100000:0.0:1788448565.358122:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387456 00000100:00100000:0.0:1788448565.358150:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448565.358158:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826387456:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448565.358196:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448565.358209:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788448565.364715:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788448565.367874:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788448565.369285:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17124:x1875323826387456:12345-0@lo:253:mount.lustre.0 Request processed in 11120us (11207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.369297:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448565.369400:0:17124:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17124:1875323826387456:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788448565.369415:0:17124:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788448565.369419:0:17124:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448565.369421:0:17124:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448565.369422:0:17124:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448565.369423:0:17124:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448565.369424:0:17124:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448565.369425:0:17124:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448565.369427:0:17124:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448565.369428:0:17124:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448565.369430:0:17124:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448565.369431:0:17124:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788448565.369445:0:17124:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788448565.372120:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788448565.372128:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788448565.372151:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.372167:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.372175:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.372216:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 11 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.372231:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 11 pid: 17138 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448565.372244:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826387584:0@lo:104: 00000100:00100000:3.0:1788448565.372498:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448565.372685:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.372731:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387584 00000100:00100000:0.0:1788448565.372738:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387584 00000100:00100000:0.0:1788448565.372790:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448565.372798:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826387584:12345-0@lo:104: 00010000:00010000:0.0:1788448565.372810:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.372867:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448565.372873:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826387584:12345-0@lo:104: Request processed in 76us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.372895:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788448565.372923:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448565.372929:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.372936:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330c00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448565.372945:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.373018:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448565.373280:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448565.373286:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448565.373662:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.373670:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448565.373700:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.373707:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8048a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048ab expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.373723:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448565.373725:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448565.373727:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448565.373777:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826387712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448565.373786:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826387584:0@lo:104: 00010000:00010000:3.0:1788448565.373804:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448565.373817:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448565.374083:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387712 00000100:00100000:3.0:1788448565.374089:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387712 00010000:00010000:3.0:1788448565.374109:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 12 pid: 17138 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448565.374150:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448565.374159:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:3645:x1875323826387712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448565.374170:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448565.374175:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 12 pid: 17138 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374185:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 12 pid: 17138 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374198:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8048ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8048a4 expref: 12 pid: 17138 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374213:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374221:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788448565.374233:0:17130:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002104653s 00010000:00010000:3.0:1788448565.374237:0:17130:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374244:0:17130:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374250:0:17130:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374257:0:17130:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374268:0:17130:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152ec00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448565.374272:0:17130:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.374280:0:17130:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.382252:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448565.382268:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.383849:0:17130:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.383872:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.383908:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448565.384082:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:3645:x1875323826387712:12345-0@lo:103:ldlm_bl.0 Request processed in 9919us (10259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448565.384094:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448565.384169:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826387712:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788448565.405139:0:17124:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788448565.405685:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788448565.405688:0:17185:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788448565.405693:0:17185:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788448565.406171:0:17186:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788448565.406271:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:2.0:1788448565.407730:0:17186:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788448565.409175:0:17187:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9fc0835d0380 x1875323826387840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448565.409201:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00000040:01000000:0.0:1788448565.409715:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788448565.409751:0:17124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788448565.410809:0:17124:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788448565.410830:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788448565.412438:0:17124:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448565.412686:0:17186:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788448565.412760:0:17186:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788448565.414689:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788448565.416278:0:17124:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788448565.416463:0:17124:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788448565.418448:0:17124:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:3.0:1788448565.426663:0:17124:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788448565.429202:0:17124:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788448565.429247:0:17124:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbf8c01a3b988 00100000:10000000:3.0:1788448565.429264:0:17124:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788448565.436268:0:17124:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788448565.436284:0:17124:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788448565.436313:0:17124:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788448565.436329:0:17124:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788448565.437215:0:17124:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448565.437403:0:17124:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448565.950035:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788448565.957537:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448565.957544:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6b800 from 7 10000000:01000000:0.0:1788448565.957549:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448565.957604:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.957624:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448565.957636:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448565.957663:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826387968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448565.957735:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448565.957807:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0810c1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448565.959315:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387968 00000100:00100000:3.0:1788448565.959329:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387968 00000100:00100000:3.0:1788448565.959396:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448565.959407:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+11:17142:x1875323826387968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448565.959423:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448565.959443:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8048e3 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.959471:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.959482:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.959491:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152ec00, rc 0) 00000100:00100000:3.0:1788448565.959558:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17142:x1875323826387968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448565.959565:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448565.959631:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826387968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448565.959649:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.959658:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448565.959723:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826388096:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788448565.959761:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448565.959809:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448565.959963:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826388096 00000100:00100000:0.0:1788448565.959968:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826388096 00000100:00100000:0.0:1788448565.959999:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448565.960006:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17142:x1875323826388096:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788448565.960024:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788448565.960040:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788448565.960043:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788448565.960125:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17142:x1875323826388096:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448565.960132:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448565.961567:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826388096:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788448565.961647:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448565.961657:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448565.961667:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448566.404964:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448566.469359:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448566.974027:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448567.423294:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448567.488922:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448568.002800:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448568.512711:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448569.024958:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448569.534926:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448570.046453:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448570.397633:0:17430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788448570.558131:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788448570.558138:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788448570.558142:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448570.558149:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788448570.558154:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448570.558161:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1bb74e800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448570.558184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d0700 x1875323826388352/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448570.558203:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448570.558207:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448570.558209:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448570.558212:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448570.558214:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788448570.558216:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788448570.558218:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc08360a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448570.558224:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9fc08360a800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448570.558247:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d3480 x1875323826388480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448570.558280:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388352:0@lo:38:kworker.0 00000100:00100000:3.0:1788448570.558351:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448570.558397:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826388480:0@lo:38:kworker.0 00000100:00100000:3.0:1788448570.558427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448570.558496:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448570.558512:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448570.558543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448570.558610:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826388480 00000100:00100000:1.0:1788448570.558617:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826388480 00000100:00100000:1.0:1788448570.558649:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448570.558656:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826388480:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788448570.558678:0:17147:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788448570.558712:0:17147:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf45a9e4e6b8048f1 00000004:00100000:1.0:1788448570.558726:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788448570.558857:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9fc08360f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448570.558938:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875323826388480:12345-0@lo:38:kworker.0 Request processed in 281us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448570.558946:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448570.558985:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc0835d3480 x1875323826388480/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448570.558999:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788448570.559006:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788448570.559010:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788448570.559012:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc08360a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788448570.559018:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875323826388480:0@lo:38:kworker.0 00000100:00100000:2.0:1788448570.559161:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826388352 00000100:00100000:2.0:1788448570.559166:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826388352 00000100:00100000:2.0:1788448570.559186:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448570.559191:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826388352:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788448570.559203:0:17150:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788448570.559534:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826388224 00000100:00100000:3.0:1788448570.559539:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826388224 00000100:00100000:3.0:1788448570.559578:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448570.559585:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:3645:x1875323826388224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448570.559638:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:3645:x1875323826388224:12345-0@lo:400:kworker.0 Request processed in 54us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448570.559645:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448570.562975:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826388224:0@lo:400:kworker.0 00000100:00100000:3.0:1788448570.563531:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00000100:00100000:1.0:1788448570.597128:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826388352:12345-0@lo:38:kworker.0 Request processed in 37929us (38770us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448570.597146:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788448570.597201:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448570.597206:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448570.597220:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388352:0@lo:38:kworker.0 00010000:00010000:1.0:1788448571.070556:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788448571.318644:0:17482:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448571.318827:0:17482:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788448571.586325:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448572.099556:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788448572.331805:0:17532:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448572.333409:0:17532:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788448572.606107:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:2.0:1788448573.118626:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448573.631249:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448574.152215:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448574.661591:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:2.0:1788448575.166094:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788448575.678175:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448575.678182:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788448575.678185:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448575.678209:0:16256:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 487 00000100:00080000:1.0:1788448575.678215:0:16256:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788448575.678222:0:16256:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1bb74e800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448575.678256:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc08368a680 x1875323826388736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448575.678369:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448565/real 1788448565] req@ffff9fc19137dc00 x1875323826385408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448575.678395:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc19137dc00 x1875323826385408/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448575.678405:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448565/real 1788448565] req@ffff9fc1bf7c8e00 x1875323826385280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448575 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448575.678416:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc1bf7c8e00 x1875323826385280/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448575 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448575.678462:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448575.678478:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788448575.678483:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826385408:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788448575.678489:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448575.678496:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788448575.678499:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826385280:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788448575.678552:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788448575.678632:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448575.678699:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826388608 00000100:00100000:3.0:1788448575.678706:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826388608 00000100:00100000:3.0:1788448575.678742:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448575.678751:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:3647:x1875323826388608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448575.678797:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:3647:x1875323826388608:12345-0@lo:400:kworker.0 Request processed in 46us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448575.678804:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448575.678847:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826388608:0@lo:400:kworker.0 00000100:00080000:1.0:1788448575.679254:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448575.679257:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788448575.679259:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448575.679426:0:16256:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1788448575.679431:0:16256:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448575.679436:0:16256:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc082765000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448575.679521:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc08368b480 x1875323826388864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448575.679532:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448575.679535:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788448575.679537:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448575.679540:0:16256:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:1.0:1788448575.679542:0:16256:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788448575.679556:0:16256:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc187ba0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448575.679580:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc08368b800 x1875323826388992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448575.679643:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826389120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448575.679684:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448575.680009:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389120 00000100:00100000:3.0:1788448575.680016:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389120 00000100:00100000:3.0:1788448575.680057:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448575.680066:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826389120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448575.680116:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826389120:12345-0@lo:400:kworker.0 Request processed in 52us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448575.680123:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788448575.680167:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc083689f80 x1875323826389120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448591 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448575.680179:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788448575.680520:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388736:0@lo:38:kworker.0 00000100:00100000:3.0:1788448575.680559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448575.680595:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388864:0@lo:8:kworker.0 00000400:00000100:3.0:1788448575.680622:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826388864 offset 0 length 520: 4 00000100:00100000:3.0:1788448575.680645:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388992:0@lo:8:kworker.0 00000400:00000100:3.0:1788448575.680681:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826388992 offset 0 length 520: 4 00000100:00100000:3.0:1788448575.680719:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826388736 00000100:00100000:3.0:1788448575.680723:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826388736 00000100:00100000:3.0:1788448575.680742:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448575.680747:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826388736:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788448575.680764:0:17151:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788448575.681607:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00000100:00100000:3.0:1788448575.699596:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826388736:12345-0@lo:38:kworker.0 Request processed in 18839us (19028us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788448575.699611:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788448575.699827:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448575.699834:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788448575.699838:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388736:0@lo:38:kworker.0 00010000:00010000:1.0:1788448576.190978:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448576.711129:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:2.0:1788448577.215166:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448577.662756:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448577.727022:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448578.238656:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448578.750140:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:3.0:1788448579.265688:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448579.412362:0:17877:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788448579.412367:0:17877:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788448579.412368:0:17877:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788448579.412470:0:17877:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc187ba7000 00000020:01000004:2.0:1788448579.412487:0:17877:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788448579.412498:0:17877:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788448579.412512:0:17877:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9fc0823d19b8) 00000020:00000080:2.0:1788448579.412528:0:17877:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448579.503746:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788448579.504460:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.505145:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.505357:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.505778:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.507165:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.507469:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.509595:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.510608:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.511367:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.512069:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.512858:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.513149:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.513476:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.513780:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.514042:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.514289:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.514756:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.514975:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.515176:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.516191:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.516524:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.517570:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.518769:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.519093:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.519272:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.519498:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.519761:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.520043:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.520255:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.520480:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.520834:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788448579.521206:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.521463:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788448579.529249:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788448579.530518:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788448579.531857:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788448579.532242:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788448579.532477:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788448579.532768:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788448579.532980:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788448579.533285:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788448579.533488:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788448579.533814:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788448579.534253:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788448579.534518:0:17877:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788448579.535223:0:17877:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788448579.535448:0:17877:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788448579.535459:0:17877:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788448579.535471:0:17877:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b8048ff 00000020:01000004:2.0:1788448579.535478:0:17877:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788448579.535497:0:17877:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788448579.535501:0:17877:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788448579.535506:0:17877:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788448579.535528:0:17877:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788448579.535532:0:17877:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788448579.541855:0:17877:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448579.541918:0:17877:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788448579.541923:0:17877:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448579.541924:0:17877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448579.541925:0:17877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448579.541927:0:17877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448579.541932:0:17877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448579.541933:0:17877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448579.541935:0:17877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448579.541937:0:17877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448579.541938:0:17877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448579.541941:0:17877:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788448579.541943:0:17877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448579.541945:0:17877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448579.541946:0:17877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448579.541947:0:17877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448579.541948:0:17877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448579.541949:0:17877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448579.541950:0:17877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448579.541951:0:17877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448579.541952:0:17877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448579.541983:0:17877:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788448579.542001:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389248:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448579.542069:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.542254:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08272a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.542338:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389248 00000100:00100000:3.0:1788448579.542347:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389248 00000100:00100000:3.0:1788448579.542439:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448579.542449:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17877:x1875323826389248:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788448579.542478:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788448579.542481:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788448579.542488:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788448579.542799:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17877:x1875323826389248:12345-0@lo:253:mount.lustre.0 Request processed in 349us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.542807:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448579.542915:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389248:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448579.542927:0:17877:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788448579.542929:0:17877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448579.542930:0:17877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448579.542931:0:17877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448579.542932:0:17877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448579.542933:0:17877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448579.542933:0:17877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448579.542934:0:17877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448579.542936:0:17877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448579.542937:0:17877:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448579.542953:0:17877:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc187ba7000 from lustre-MDT0001 10000000:01000000:2.0:1788448579.542979:0:17877:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788448579.542981:0:17877:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788448579.542987:0:17877:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc1bb53cd28 local copy 00010000:00010000:2.0:1788448579.542996:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.543098:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389376:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448579.543130:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.543441:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.543584:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389376 00000100:00100000:0.0:1788448579.543591:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389376 00000100:00100000:0.0:1788448579.543624:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448579.543631:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17877:x1875323826389376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448579.543773:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17877:x1875323826389376:12345-0@lo:501:mount.lustre.0 Request processed in 142us (643us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448579.543780:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448579.543866:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389376:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448579.543879:0:17877:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788448579.543930:0:17877:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788448579.543937:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.543946:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.543971:0:17877:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc187ba7000 10000000:01000000:2.0:1788448579.543976:0:17877:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448579.543980:0:17877:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9fc1bb53cd28 10000000:01000000:2.0:1788448579.543982:0:17877:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788448579.543985:0:17877:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9fc1bb53cd28 from 1 10000000:01000000:2.0:1788448579.543987:0:17877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788448579.544010:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.544017:0:17877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.544025:0:17877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.544053:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448579.544078:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.544094:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.544298:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389504 00000100:00100000:0.0:1788448579.544308:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389504 00000100:00100000:0.0:1788448579.544340:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448579.544347:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+12:17877:x1875323826389504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448579.544354:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448579.544366:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b80490d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804906 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.544387:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b80490d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804906 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.544398:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351fc00/0xf45a9e4e6b80490d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804906 expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.544406:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fc00, rc 0) 00000100:00100000:0.0:1788448579.544456:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+13:17877:x1875323826389504:12345-0@lo:101:mount.lustre.0 Request processed in 109us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.544461:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448579.544634:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448579.544647:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.544656:0:17877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.544682:0:17877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788448579.544694:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.544702:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331a00/0xf45a9e4e6b804906 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80490d expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.544710:0:17877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9fc187ba7000 10000000:01000000:2.0:1788448579.544714:0:17877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788448579.544717:0:17877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9fc187ba7000 from 1 10000000:01000000:2.0:1788448579.544720:0:17877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788448579.544735:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.544742:0:17877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.544748:0:17877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.544768:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448579.544795:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.544810:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.544988:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389632 00000100:00100000:0.0:1788448579.544993:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389632 00000100:00100000:0.0:1788448579.545015:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448579.545022:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+13:17877:x1875323826389632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448579.545029:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448579.545037:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351e200/0xf45a9e4e6b80491b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804914 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.545053:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351e200/0xf45a9e4e6b80491b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804914 expref: 14 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.545062:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351e200/0xf45a9e4e6b80491b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804914 expref: 14 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.545076:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e200, rc 0) 00000100:00100000:0.0:1788448579.545116:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+14:17877:x1875323826389632:12345-0@lo:101:mount.lustre.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.545122:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448579.545191:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448579.545201:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.545208:0:17877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.545218:0:17877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788448579.545233:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.545239:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330400/0xf45a9e4e6b804914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b80491b expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.545245:0:17877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788448579.545249:0:17877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448579.545253:0:17877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9fc187ba7000 10000000:01000000:2.0:1788448579.545255:0:17877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788448579.545258:0:17877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788448579.545260:0:17877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788448579.545273:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.545280:0:17877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.545293:0:17877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.545306:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389760:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448579.545333:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.545353:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.545404:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389760 00000100:00100000:0.0:1788448579.545408:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389760 00000100:00100000:0.0:1788448579.545439:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448579.545445:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+14:17877:x1875323826389760:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448579.545453:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448579.545462:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351f400/0xf45a9e4e6b804929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804922 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.545476:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351f400/0xf45a9e4e6b804929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804922 expref: 15 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.545484:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351f400/0xf45a9e4e6b804929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804922 expref: 15 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.545491:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f400, rc 0) 00000100:00100000:0.0:1788448579.545530:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826389760:12345-0@lo:101:mount.lustre.0 Request processed in 85us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.545536:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448579.545679:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389760:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448579.545690:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.545697:0:17877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448579.546941:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1788448579.547500:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448579.560231:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788448579.560290:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1788448579.560307:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1788448579.560320:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1788448579.560332:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:2.0:1788448579.560344:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:2.0:1788448579.560355:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:2.0:1788448579.560366:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1788448579.560377:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1788448579.560388:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:2.0:1788448579.560405:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:2.0:1788448579.560432:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:2.0:1788448579.560448:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:2.0:1788448579.560460:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1788448579.560485:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1788448579.560500:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:2.0:1788448579.560513:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788448579.560524:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788448579.560534:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:2.0:1788448579.560556:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788448579.560569:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788448579.560580:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788448579.560591:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788448579.560618:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:2.0:1788448579.560623:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:2.0:1788448579.563046:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448579.563127:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.563162:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.563360:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826389888 00000100:00100000:0.0:1788448579.563367:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826389888 00000100:00100000:0.0:1788448579.563420:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448579.563430:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826389888:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448579.563576:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826389888:12345-0@lo:501:mount.lustre.0 Request processed in 147us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.563595:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448579.564196:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826389888:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448579.564242:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826390016:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448579.564292:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.564330:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448579.564404:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390016 00000100:00100000:1.0:1788448579.564409:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390016 00000100:00100000:1.0:1788448579.564452:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448579.564459:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826390016:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448579.565557:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826390016:12345-0@lo:503:mount.lustre.0 Request processed in 1082us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448579.565568:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448579.565661:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826390016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448579.566605:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448579.566804:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826390144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448579.566869:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.566986:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.567293:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390144 00000100:00100000:0.0:1788448579.567300:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390144 00000100:00100000:0.0:1788448579.567394:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788448579.567404:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826390144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448579.568351:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826390144:12345-0@lo:502:mount.lustre.0 Request processed in 944us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.568362:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448579.568461:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826390144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448579.568709:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788448579.568756:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788448579.568773:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788448579.568796:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788448579.568810:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788448579.568823:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788448579.568837:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788448579.568866:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788448579.568928:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788448579.568947:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788448579.568960:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788448579.568973:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788448579.568985:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788448579.568998:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788448579.569012:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788448579.569025:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788448579.569036:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788448579.569048:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788448579.569059:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788448579.569069:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788448579.569080:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788448579.569091:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788448579.569102:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788448579.569123:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788448579.569134:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788448579.569143:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788448579.569153:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788448579.569163:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788448579.569175:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788448579.569188:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788448579.569201:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788448579.569214:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788448579.569225:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788448579.569238:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788448579.569251:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788448579.569263:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788448579.569285:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788448579.569300:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788448579.569313:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788448579.569339:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788448579.569353:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788448579.569365:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788448579.569378:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788448579.569391:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788448579.569430:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826390272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448579.569486:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.569994:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037b600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.570103:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390272 00000100:00100000:3.0:1788448579.570110:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390272 00000100:00100000:3.0:1788448579.570144:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448579.570151:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826390272:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448579.570286:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826390272:12345-0@lo:502:mount.lustre.0 Request processed in 134us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.570294:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448579.570469:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826390272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448579.570526:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788448579.570536:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788448579.571470:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448579.571482:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448579.571484:0:17881:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788448579.571488:0:17881:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788448579.571490:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448579.571502:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9fc0823d4d28) 00000020:00000080:2.0:1788448579.571520:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788448579.571524:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788448579.571621:0:17881:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448579.571628:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b804937 00000020:00000080:2.0:1788448579.572277:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788448579.572284:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448579.572289:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448579.572290:0:17881:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788448579.572293:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448579.572297:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448579.572299:0:17881:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788448579.572309:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448579.572318:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9fc0823d0000) 00000020:00000080:2.0:1788448579.572330:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788448579.572334:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788448579.572336:0:17881:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788448579.572338:0:17881:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788448579.572343:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788448579.572399:0:17881:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc187ba7000 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788448579.572413:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9fc19138b370) 00000020:00000080:2.0:1788448579.572437:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788448579.572507:0:17881:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788448579.572514:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80494c 00000020:00000080:2.0:1788448579.572623:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788448579.572630:0:17881:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788448579.572634:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xf45a9e4e6b804953 00080000:01000000:2.0:1788448579.572640:0:17881:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788448579.572643:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b80495a 00010000:00010000:1.0:1788448579.676270:0:17881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788448579.676878:0:17881:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788448579.677272:0:17881:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788448579.678482:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788448579.678495:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.678502:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.678504:0:17881:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788448579.678508:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448579.678513:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.678514:0:17881:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788448579.678517:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788448579.678522:0:17881:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:00000080:1.0:1788448579.678559:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448579.678573:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9fc1aeb4b370) 00000020:00000080:1.0:1788448579.678780:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788448579.678789:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788448579.678876:0:17881:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788448579.678913:0:17881:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788448579.678922:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b804968 00010000:00080000:1.0:1788448579.678951:0:17881:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc1b0353800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448579.682144:0:17881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788448579.688371:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788448579.688388:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788448579.688473:0:17881:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788448579.688499:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80496f 00000100:00080000:0.0:1788448579.688509:0:17881:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448579.688515:0:17881:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9fc1b0353800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448579.688559:0:17881:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137f100 x1875323826390400/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448579.688632:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826390400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788448579.688718:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788448579.688995:0:17881:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788448579.689059:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788448579.689064:0:16256:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788448579.689066:0:16256:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448579.689071:0:16256:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:0.0:1788448579.689075:0:16256:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788448579.689079:0:16256:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1bb74e800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448579.689092:0:16256:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137e300 x1875323826390656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448579.689759:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826390656:0@lo:38:kworker.0 00000100:00100000:1.0:1788448579.689808:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448579.689864:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390400 00000100:00100000:1.0:1788448579.689871:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390400 00000100:00100000:1.0:1788448579.689912:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390656 00000100:00100000:1.0:1788448579.689916:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390656 00000100:00100000:1.0:1788448579.689941:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448579.689948:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826390400:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788448579.689973:0:17150:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:1.0:1788448579.690006:0:17150:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b804976 00000004:00100000:1.0:1788448579.690020:0:17150:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788448579.690025:0:17150:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788448579.690109:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826390528:0@lo:400:kworker.0 00000100:00100000:1.0:1788448579.690139:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788448579.690323:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.690329:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.690331:0:17881:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788448579.690334:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788448579.690337:0:17881:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788448579.690343:0:17881:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448579.690345:0:17881:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448579.690346:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788448579.690349:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.690350:0:17881:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788448579.690352:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448579.690356:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.690358:0:17881:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788448579.690361:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788448579.690421:0:17881:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788448579.690443:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.690447:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.690448:0:17881:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788448579.690451:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788448579.690452:0:17881:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788448579.690453:0:17881:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448579.690455:0:17881:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448579.690457:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788448579.690459:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.690460:0:17881:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788448579.690462:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448579.690466:0:17881:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788448579.690469:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.690470:0:17881:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788448579.690473:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788448579.690477:0:17881:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:1.0:1788448579.690498:0:17881:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788448579.690500:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448579.690513:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9fc1aeb4cd28) 00000020:00000080:1.0:1788448579.690526:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788448579.690531:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788448579.690612:0:17881:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788448579.690618:0:17881:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788448579.690631:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b804984 00010000:00080000:1.0:1788448579.690790:0:17881:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc185684000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.121@tcp at head 00000100:00100000:3.0:1788448579.691129:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390528 00000100:00100000:3.0:1788448579.691136:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390528 00000100:00100000:3.0:1788448579.691174:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448579.691184:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:3645:x1875323826390528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448579.691246:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:3645:x1875323826390528:12345-0@lo:400:kworker.0 Request processed in 64us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.691254:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448579.691298:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826390528:0@lo:400:kworker.0 00000100:00080000:0.0:1788448579.691710:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.691716:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448579.691719:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.691721:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448579.691777:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788448579.692466:0:17881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788448579.692866:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826390784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448579.692935:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448579.693021:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390784 00000100:00100000:1.0:1788448579.693027:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390784 00000100:00100000:1.0:1788448579.693098:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448579.693107:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826390784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448579.693166:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826390784:12345-0@lo:400:kworker.0 Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448579.693182:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788448579.693380:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc19137ca80 x1875323826390784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448579.693394:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826390784:0@lo:400:kworker.0 00000040:01000000:1.0:1788448579.694139:0:17881:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788448579.694337:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788448579.696620:0:17150:0:(import.c:65:import_set_state_nolock()) ffff9fc183e90800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448579.696897:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826390400:12345-0@lo:38:llog_process_th.0 Request processed in 6928us (8160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.696907:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448579.696935:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448579.696942:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826390656:12345-0@lo:38:kworker.0 00000040:00080000:2.0:1788448579.696955:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448579.696984:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875323826390656:12345-0@lo:38:kworker.0 Request processed in 41us (7175us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788448579.696990:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448579.697094:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448579.697102:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1788448579.697110:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788448579.697115:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788448579.697117:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1b0353800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788448579.697134:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826390400:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788448579.697158:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448579.697162:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448579.697166:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788448579.697169:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826390656:0@lo:38:kworker.0 00000100:00100000:1.0:1788448579.697214:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448579.697230:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826390912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448579.697265:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448579.697306:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826390912 00000100:00100000:3.0:1788448579.697312:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826390912 00000100:00100000:3.0:1788448579.697348:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448579.697354:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875323826390912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448579.697374:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788448579.697418:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3648:x1875323826390912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.697435:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448579.697565:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826390912:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788448579.697690:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788448579.697806:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1788448579.698441:0:17886:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448579.698446:0:17886:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788448579.699155:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448579.699167:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788448579.699202:0:17881:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788448579.699222:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b80498b 00000100:00080000:1.0:1788448579.699231:0:17881:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448579.699235:0:17881:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc185684000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448579.699264:0:17881:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083688380 x1875323826391040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448579.699291:0:17881:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788448579.699367:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.699371:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448579.699374:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.699377:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:1.0:1788448579.699383:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.699386:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.699388:0:17881:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788448579.699391:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788448579.699394:0:17881:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1788448579.699395:0:17881:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448579.699397:0:17881:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788448579.699398:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788448579.699401:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.699402:0:17881:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788448579.699406:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448579.699410:0:17881:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788448579.699413:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.699415:0:17881:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000100:00100000:3.0:1788448579.699425:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826391040:0@lo:8:llog_process_th.0 00000020:00000080:1.0:1788448579.699429:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788448579.699433:0:17881:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.121@tcp to nid 0x20000c0a8ce79 (192.168.206.121@tcp) 00000020:01000000:1.0:1788448579.699452:0:17881:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788448579.699454:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448579.699464:0:17881:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9fc1aeb499b8) 00000400:00000100:3.0:1788448579.699476:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826391040 offset 0 length 520: 4 00000020:00000080:1.0:1788448579.699480:0:17881:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788448579.699485:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788448579.699554:0:17881:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788448579.699562:0:17881:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788448579.699567:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xf45a9e4e6b804999 00010000:00080000:1.0:1788448579.699603:0:17881:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc190ac4000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.121@tcp at head 00010000:00010000:1.0:1788448579.699817:0:17881:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788448579.699874:0:17881:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788448579.699907:0:17881:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788448579.701620:0:17881:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448579.701976:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788448579.702118:0:17881:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788448579.702563:0:17888:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788448579.702568:0:17888:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788448579.704143:0:17881:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788448579.704156:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788448579.704202:0:17881:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788448579.704224:0:17881:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b8049a0 00000100:00080000:1.0:1788448579.704233:0:17881:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448579.704239:0:17881:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc190ac4000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448579.704274:0:17881:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc08368bb80 x1875323826391168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448579.704344:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826391168:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788448579.704395:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826391168 offset 0 length 520: 4 00000100:00080000:1.0:1788448579.704446:0:17881:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788448579.704498:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.704502:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.704504:0:17881:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788448579.704507:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448579.704510:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.704511:0:17881:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448579.704514:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448579.704516:0:17881:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448579.704518:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.704520:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.704529:0:17881:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788448579.704532:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448579.704534:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.704535:0:17881:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448579.704538:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788448579.704576:0:17881:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448579.704580:0:17881:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448579.704581:0:17881:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448579.704584:0:17881:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00080000:0.0:1788448579.704805:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.704810:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448579.704813:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.704816:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:2.0:1788448579.705027:0:17877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788448579.705055:0:17877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788448579.705075:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.705085:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330600/0xf45a9e4e6b804922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804929 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.705093:0:17877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc187ba7000 from 1 10000000:01000000:2.0:1788448579.705096:0:17877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448579.705124:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.705132:0:17877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.705143:0:17877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.705158:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448579.705197:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.705224:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:1.0:1788448579.705299:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826391296 00000100:00100000:1.0:1788448579.705305:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826391296 00000100:00100000:1.0:1788448579.705349:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448579.705358:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+15:17877:x1875323826391296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448579.705369:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448579.705382:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8049a7 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448579.705403:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448579.705413:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 16 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448579.705421:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc400, rc 0) 00000100:00100000:1.0:1788448579.705466:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17877:x1875323826391296:12345-0@lo:101:mount.lustre.0 Request processed in 109us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448579.705473:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448579.705581:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448579.705659:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.705669:0:17877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.706266:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391424:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788448579.706304:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.706364:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.706525:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826391424 00000100:00100000:0.0:1788448579.706531:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826391424 00000100:00100000:0.0:1788448579.706659:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448579.706668:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17877:x1875323826391424:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788448579.706685:0:17139:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788448579.706700:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788448579.706706:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788448579.706791:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17877:x1875323826391424:12345-0@lo:256:mount.lustre.0 Request processed in 124us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.706798:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788448579.706864:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391424:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788448579.707447:0:17877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448579.707472:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.707482:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.707497:0:17877:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc187ba7000 from 1 10000000:01000000:2.0:1788448579.707500:0:17877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448579.707523:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.707530:0:17877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.707537:0:17877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.707563:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448579.707604:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448579.707866:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826391552 00000100:00100000:1.0:1788448579.707872:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826391552 00000100:00100000:1.0:1788448579.707914:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448579.707921:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17877:x1875323826391552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448579.707937:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448579.707949:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8049b5 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448579.707968:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448579.707977:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448579.707984:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc800, rc 0) 00000100:00100000:1.0:1788448579.708013:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391552:12345-0@lo:101:mount.lustre.0 Request processed in 93us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448579.708018:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448579.708152:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba2cb240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448579.708392:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448579.708409:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.708417:0:17877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448579.708561:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448579.708651:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448579.708680:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.708737:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448579.708780:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826391680 00000100:00100000:1.0:1788448579.708785:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826391680 00000100:00100000:1.0:1788448579.708859:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448579.708868:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448579.709003:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391680:12345-0@lo:501:mount.lustre.0 Request processed in 136us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448579.709010:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448579.709260:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448579.709289:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448579.709327:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448579.709354:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0826a8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.709397:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826391808 00000100:00100000:3.0:1788448579.709401:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826391808 00000100:00100000:3.0:1788448579.709432:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448579.709440:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448579.710107:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391808:12345-0@lo:503:mount.lustre.0 Request processed in 665us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.710116:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448579.710791:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391808:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448579.711301:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448579.711383:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448579.711511:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.711538:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.711700:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826391936 00000100:00100000:0.0:1788448579.711707:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826391936 00000100:00100000:0.0:1788448579.711752:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448579.711761:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391936:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448579.711870:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826391936:12345-0@lo:502:mount.lustre.0 Request processed in 106us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.711877:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788448579.713091:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826391936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448579.713326:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788448579.713358:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788448579.713374:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788448579.713388:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788448579.713399:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788448579.713412:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788448579.713425:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788448579.713438:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788448579.713451:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788448579.713463:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788448579.713477:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788448579.713510:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448579.713573:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448579.714335:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448579.714766:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392064 00000100:00100000:1.0:1788448579.714774:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392064 00000100:00100000:1.0:1788448579.714859:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448579.714869:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826392064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448579.715027:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826392064:12345-0@lo:502:mount.lustre.0 Request processed in 150us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448579.715047:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448579.715127:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448579.715187:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:3.0:1788448579.715198:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788448579.715739:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448579.715747:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715750:0:17890:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788448579.715756:0:17890:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc187ba7000 00000020:00000080:3.0:1788448579.715759:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448579.715768:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448579.715771:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715772:0:17890:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788448579.715775:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448579.715777:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715779:0:17890:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788448579.715783:0:17890:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc187ba7000 00000020:00000080:3.0:1788448579.715785:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448579.715844:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448579.715847:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715849:0:17890:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788448579.715851:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448579.715853:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715855:0:17890:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448579.715858:0:17890:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc187ba7000 00000020:00000080:3.0:1788448579.715861:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448579.715878:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448579.715906:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715907:0:17890:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788448579.715910:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448579.715913:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715915:0:17890:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788448579.715918:0:17890:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc187ba7000 00000020:00000080:3.0:1788448579.715920:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788448579.715950:0:17890:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448579.715953:0:17890:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448579.715955:0:17890:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788448579.715958:0:17890:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:3.0:1788448579.718937:0:17877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788448579.718981:0:17877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448579.718999:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448579.719010:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448579.719082:0:17877:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448579.719086:0:17877:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc187ba7000 10000000:01000000:3.0:1788448579.719088:0:17877:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc187ba7000 10000000:01000000:3.0:1788448579.719092:0:17877:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448579.719096:0:17877:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc187ba7000 from 1 10000000:01000000:3.0:1788448579.719099:0:17877:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448579.719132:0:17877:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448579.719140:0:17877:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448579.719150:0:17877:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448579.719176:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448579.719244:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.721964:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.722202:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392192 00000100:00100000:0.0:1788448579.722213:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392192 00000100:00100000:0.0:1788448579.722266:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448579.722276:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17877:x1875323826392192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448579.722291:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448579.722309:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8049ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8049c3 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.722337:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8049ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049c3 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.722348:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351e800/0xf45a9e4e6b8049ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049c3 expref: 18 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448579.722365:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351e800, rc 0) 00000100:00100000:0.0:1788448579.722441:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392192:12345-0@lo:101:mount.lustre.0 Request processed in 166us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.722448:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448579.725158:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448579.725183:0:17877:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.725195:0:17877:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448579.728942:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788448579.729285:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448579.729770:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788448579.729797:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788448579.729814:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788448579.729829:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788448579.729844:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788448579.729859:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788448579.729871:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788448579.729920:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788448579.729937:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788448579.729949:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788448579.729960:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788448579.729972:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788448579.729984:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788448579.729996:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788448579.730008:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788448579.730434:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788448579.730455:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788448579.730467:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788448579.730490:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788448579.730504:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788448579.730517:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788448579.730529:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788448579.730561:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788448579.730578:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788448579.730604:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788448579.730744:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788448579.730759:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788448579.730773:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788448579.730793:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788448579.730798:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788448579.730907:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448579.730967:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.731007:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.731153:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392320 00000100:00100000:3.0:1788448579.731160:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392320 00000100:00100000:3.0:1788448579.731203:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448579.731210:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448579.736152:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392320:12345-0@lo:501:mount.lustre.0 Request processed in 4932us (5175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.736167:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448579.740841:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448579.740926:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448579.740993:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.741698:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969760c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448579.742744:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392448 00000100:00100000:2.0:1788448579.742757:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392448 00000100:00100000:2.0:1788448579.742820:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448579.742830:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448579.743572:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392448:12345-0@lo:503:mount.lustre.0 Request processed in 741us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.743582:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448579.743745:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392448:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788448579.746292:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448579.746392:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392576:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448579.747770:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448579.747870:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1ba3a2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448579.753574:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392576 00000100:00100000:2.0:1788448579.753727:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392576 00000100:00100000:3.0:1788448579.758623:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448579.758637:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448579.758800:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392576:12345-0@lo:502:mount.lustre.0 Request processed in 166us (11035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.758808:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448579.758930:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392576:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448579.759148:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788448579.759179:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788448579.759194:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788448579.759206:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788448579.759219:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788448579.759232:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788448579.759246:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788448579.759259:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788448579.759272:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788448579.759286:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788448579.759297:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788448579.759310:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788448579.759336:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788448579.759351:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788448579.759363:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788448579.759375:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788448579.759388:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788448579.759402:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788448579.759416:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788448579.759449:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788448579.759479:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788448579.759495:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788448579.759508:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788448579.759522:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788448579.759535:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788448579.759559:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788448579.759572:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788448579.759583:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788448579.759595:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788448579.759607:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788448579.759620:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788448579.759632:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788448579.759643:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788448579.759655:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788448579.759668:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788448579.759679:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788448579.759703:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788448579.759719:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788448579.759730:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788448579.759741:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788448579.759752:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788448579.759764:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788448579.759777:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788448579.759790:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788448579.759802:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788448579.759824:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788448579.759836:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788448579.759848:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788448579.759917:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392704:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448579.759968:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448579.760006:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392704 00000100:00100000:3.0:1788448579.760011:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392704 00000100:00100000:3.0:1788448579.760043:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448579.760049:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392704:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448579.765572:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b03bcf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.766196:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392704:12345-0@lo:502:mount.lustre.0 Request processed in 6142us (6224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.766209:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448579.766277:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392704:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448579.767830:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788448579.767896:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788448579.768756:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448579.768826:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448579.768863:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b03bcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448579.770034:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392832 00000100:00100000:2.0:1788448579.770045:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392832 00000100:00100000:2.0:1788448579.770096:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788448579.770105:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392832:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448579.770238:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826392832:12345-0@lo:502:mount.lustre.0 Request processed in 133us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.770246:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788448579.770321:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826392832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448579.770402:0:17877:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:2.0:1788448579.771698:0:17877:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788448579.775100:0:17896:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788448579.775116:0:17896:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9fc1aeb48000) 00000020:00000080:1.0:1788448579.775137:0:17896:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788448579.775221:0:17896:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc187ba7000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788448579.775225:0:17896:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc187ba7000 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788448579.775228:0:17896:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc187ba7000 3 00010000:00080000:1.0:1788448579.775255:0:17896:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc187400000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.121@tcp at head 00000100:00100000:0.0:1788448579.775776:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448579.781505:0:17896:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788448579.781816:0:17896:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788448579.781858:0:17896:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788448579.781870:0:17896:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xf45a9e4e6b8049d8 00000100:00080000:1.0:1788448579.781907:0:17896:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448579.781914:0:17896:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9fc187400000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448579.781945:0:17896:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083688e00 x1875323826392960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448579.781972:0:17896:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788448579.782000:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.782005:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448579.782008:0:16256:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448579.782010:0:16256:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448579.782513:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826392960:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448579.782599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448579.783716:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826392960 00000100:00100000:0.0:1788448579.783727:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826392960 00000100:00100000:0.0:1788448579.783768:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448579.783777:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826392960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788448579.783803:0:17147:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1788448579.783838:0:17147:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xf45a9e4e6b8049df 00000004:00100000:0.0:1788448579.783853:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788448579.783897:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb4c6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448579.784764:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875323826392960:12345-0@lo:38:llog_process_th.0 Request processed in 982us (2161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.784774:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788448579.785021:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc083688e00 x1875323826392960/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448579.785033:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448579.785041:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788448579.785049:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788448579.785054:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448579.785056:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187400000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448579.785064:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875323826392960:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788448579.785244:0:17896:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:2.0:1788448579.785695:0:17877:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788448579.785723:0:17877:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448579.785746:0:17877:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.785773:0:17877:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc18152ee00/0xf45a9e4e6b8049c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049ca expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788448579.785824:0:17877:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788448579.785826:0:17877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448579.785827:0:17877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448579.785829:0:17877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448579.785830:0:17877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448579.785831:0:17877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448579.785833:0:17877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448579.785835:0:17877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448579.785836:0:17877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448579.785839:0:17877:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:2.0:1788448579.785842:0:17877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448579.785843:0:17877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448579.785845:0:17877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448579.785846:0:17877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448579.785847:0:17877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448579.785848:0:17877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448579.785849:0:17877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448579.785851:0:17877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448579.785852:0:17877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448579.785870:0:17877:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788448579.785978:0:17877:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826393088:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448579.786032:0:17877:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.786070:0:17877:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1969760c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.786299:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393088 00000100:00100000:3.0:1788448579.786306:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393088 00000100:00100000:3.0:1788448579.786348:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448579.786357:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17877:x1875323826393088:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788448579.786381:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788448579.786394:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788448579.796422:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788448579.799020:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788448579.799035:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:2.0:1788448579.799116:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448579.799120:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448579.799156:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799175:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799192:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799200:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799240:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799253:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 18 pid: 17140 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.799268:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826393216:0@lo:104: 00000100:00100000:2.0:1788448579.799325:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448579.799369:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799377:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 18 pid: 17139 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.799385:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826393344:0@lo:104: 00000100:00100000:2.0:1788448579.799406:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.799434:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08264a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448579.799500:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393216 00000100:00100000:2.0:1788448579.799507:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393216 00000100:00100000:2.0:1788448579.799550:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393344 00000100:00100000:2.0:1788448579.799553:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393344 00000100:00100000:2.0:1788448579.799569:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448579.799577:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:17161:x1875323826393216:12345-0@lo:104: 00010000:00010000:2.0:1788448579.799612:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799677:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448579.799683:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:17161:x1875323826393216:12345-0@lo:104: Request processed in 107us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.799691:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448579.799707:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448579.799713:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826393344:12345-0@lo:104: 00010000:00010000:2.0:1788448579.799720:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799752:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448579.799757:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826393344:12345-0@lo:104: Request processed in 45us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.799763:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448579.799798:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826393216:0@lo:104: 00000100:00100000:2.0:1788448579.799808:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826393344:0@lo:104: 00010000:00010000:2.0:1788448579.799826:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799842:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448579.799847:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799854:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330c00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448579.799858:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799872:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448579.799898:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.799905:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448579.799930:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799937:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448579.799953:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799960:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b8049a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049ae expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799972:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448579.799975:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799980:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351f200 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:2.0:1788448579.799982:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.799988:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448579.799993:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448579.800004:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448579.800018:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800024:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448579.800039:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800045:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351f200/0xf45a9e4e6b8048e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048ea expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800057:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448579.800058:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448579.800060:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448579.800066:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448579.800076:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826393472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448579.800101:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.800136:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826393600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448579.800158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448579.800199:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393472 00000100:00100000:2.0:1788448579.800203:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393472 00010000:00010000:2.0:1788448579.800219:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 19 pid: 17140 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.800237:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393600 00000100:00100000:2.0:1788448579.800240:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393600 00010000:00010000:2.0:1788448579.800249:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 20 pid: 17139 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.800276:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448579.800282:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:3648:x1875323826393472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448579.800292:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448579.800297:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 20 pid: 17140 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800307:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 20 pid: 17140 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800320:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fc400/0xf45a9e4e6b8049ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8049a7 expref: 20 pid: 17140 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800332:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448579.800357:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:3648:x1875323826393472:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.800364:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448579.800376:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448579.800382:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3645:x1875323826393600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448579.800431:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448579.800437:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 18 pid: 17139 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800447:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 18 pid: 17139 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800457:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b8048ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8048e3 expref: 18 pid: 17139 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800481:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800489:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788448579.800501:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002104653s 00010000:00010000:2.0:1788448579.800505:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800513:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800520:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800527:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800532:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330e00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448579.800536:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800554:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800567:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800575:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448579.800606:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:3645:x1875323826393600:12345-0@lo:103:ldlm_bl.0 Request processed in 224us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.800613:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788448579.800637:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800646:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448579.800653:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b8049e6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448579.800686:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826393600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448579.800705:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826393472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448579.801246:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17877:x1875323826393088:12345-0@lo:253:mount.lustre.0 Request processed in 14889us (15212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448579.801255:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448579.801298:0:17877:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:17877:1875323826393088:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448579.801310:0:17877:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788448579.801313:0:17877:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448579.801315:0:17877:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788448579.801317:0:17877:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448579.801318:0:17877:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448579.801320:0:17877:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448579.801321:0:17877:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448579.801322:0:17877:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448579.801324:0:17877:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448579.801325:0:17877:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788448579.801335:0:17877:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788448579.818776:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788448579.819055:0:17901:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788448579.819059:0:17901:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788448579.819102:0:17902:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788448579.819225:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788448579.819503:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875323826393728:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.819579:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788448579.819876:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788448579.819932:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788448579.820336:0:17877:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788448579.820344:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788448579.820380:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448579.821252:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19399fc00 going to sleep for 11 seconds 00000040:00080000:2.0:1788448579.821833:0:17902:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448579.822952:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393728 00000100:00100000:0.0:1788448579.822963:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393728 00000100:00100000:0.0:1788448579.823014:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448579.823023:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875323826393728:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.823123:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875323826393728:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 101us (3543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.823131:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448579.823189:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875323826393728:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788448579.823225:0:17903:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788448579.823261:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875323826393856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.823297:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448579.823318:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393856 00000100:00100000:0.0:1788448579.823321:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393856 00000100:00100000:0.0:1788448579.823340:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448579.823346:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875323826393856:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.823427:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875323826393856:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 81us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.823434:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448579.823450:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1811ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.823463:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875323826393856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.823511:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875323826393984:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.823537:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448579.823570:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc19399fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448579.824853:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826393984 00000100:00100000:3.0:1788448579.824863:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826393984 00000100:00100000:3.0:1788448579.824947:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448579.824958:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875323826393984:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1788448579.825045:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17903:x1875323826393984:12345-0@lo:900:lod0001_rec0000.0 Request processed in 88us (1507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448579.825052:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788448579.825727:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788448579.826373:0:17877:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788448579.826405:0:17877:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00010000:00080000:0.0:1788448579.826777:0:17903:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9fc19137e680 x1875323826393984/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448595 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448579.826805:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17903:1875323826393984:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.827022:0:17903:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875323826394112:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.827091:0:17903:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448579.827124:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394112 00000100:00100000:0.0:1788448579.827130:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394112 00000100:00100000:0.0:1788448579.827723:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448579.827733:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875323826394112:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788448579.827827:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17903:x1875323826394112:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 95us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448579.827835:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448579.827861:0:17903:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1811ca0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448579.827877:0:17903:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17903:1875323826394112:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788448579.827941:0:17903:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448579.829349:0:17877:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448579.830376:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788448579.830447:0:17902:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00080000:10000000:1.0:1788448579.832754:0:17877:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:0.0:1788448579.836776:0:17903:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788448579.836855:0:17903:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788448579.836859:0:17903:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:1.0:1788448579.837841:0:17877:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788448579.840786:0:17877:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788448579.840827:0:17877:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbf8c016a7988 00100000:10000000:1.0:1788448579.840835:0:17877:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788448579.841562:0:17877:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788448579.841612:0:17877:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788448579.841632:0:17877:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788448579.841649:0:17877:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788448579.847325:0:17877:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448579.849028:0:17877:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448580.286074:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448580.799942:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00000040:00080000:0.0:1788448580.805723:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788448581.182578:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448581.182585:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc187ba7000 from 8 10000000:01000000:0.0:1788448581.182591:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448581.182640:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.182652:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.182670:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448581.182695:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448581.182767:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448581.182826:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448581.182911:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394240 00000100:00100000:3.0:1788448581.182919:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394240 00000100:00100000:3.0:1788448581.182979:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448581.182989:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17142:x1875323826394240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448581.183003:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448581.183016:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8049ed expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448581.183042:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448581.183053:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 17 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448581.183063:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152f800, rc 0) 00000100:00100000:3.0:1788448581.183102:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826394240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448581.183109:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788448581.183244:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448581.183258:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.183267:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448581.183313:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788448581.183342:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448581.183379:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448581.183589:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394368 00000100:00100000:3.0:1788448581.183594:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394368 00000100:00100000:3.0:1788448581.183627:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448581.183634:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826394368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788448581.183648:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448581.183662:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448581.183665:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788448581.183745:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826394368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448581.183752:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448581.184590:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788448581.184641:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448581.184649:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.184658:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448581.184668:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448581.184670:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6b800 from 8 10000000:01000000:0.0:1788448581.184676:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448581.184699:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.184707:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.184715:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448581.184729:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448581.184763:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448581.184800:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448581.184876:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394496 00000100:00100000:3.0:1788448581.184896:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394496 00000100:00100000:3.0:1788448581.184935:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448581.184942:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826394496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448581.184952:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448581.184962:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b8049fb expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448581.184979:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448581.184988:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 18 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448581.184996:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152fa00, rc 0) 00000100:00100000:3.0:1788448581.185022:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826394496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448581.185028:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448581.185152:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448581.185162:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.185170:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448581.185206:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788448581.185230:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448581.185254:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448581.185298:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394624 00000100:00100000:3.0:1788448581.185302:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394624 00000100:00100000:3.0:1788448581.185327:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448581.185334:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826394624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788448581.185344:0:17139:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448581.185357:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448581.185359:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788448581.185434:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826394624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 100us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448581.185444:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448581.185677:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826394624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788448581.185711:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448581.185717:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.185734:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.310022:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448581.822556:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448581.822828:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448582.334158:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448582.846380:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448583.359058:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448583.870123:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00010000:00010000:1.0:1788448584.382025:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448584.746188:0:18146:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788448584.894159:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448584.894180:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826394752:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448584.894247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448584.894323:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394752 00000100:00100000:3.0:1788448584.894330:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394752 00000100:00100000:3.0:1788448584.894371:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448584.894380:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826394752:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448584.894423:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788448584.894467:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826394752:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448584.894473:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448584.894529:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826394752:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448584.894898:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 0 seconds 00000100:00100000:1.0:1788448584.895111:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00080000:3.0:1788448584.895132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788448584.895136:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788448584.895139:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448584.895147:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9fc1bb74e800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448584.895167:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d2a00 x1875323826395008/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448584.895184:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448584.895188:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448584.895190:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448584.895193:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788448584.895228:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448584.895239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826395136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448584.895290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448584.901347:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826394880:0@lo:400:kworker.0 00000100:00100000:1.0:1788448584.901540:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448584.901605:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395136 00000100:00100000:1.0:1788448584.901613:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395136 00000100:00100000:0.0:1788448584.901726:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826394880 00000100:00100000:0.0:1788448584.901731:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826394880 00000100:00100000:0.0:1788448584.901774:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788448584.901784:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3648:x1875323826394880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448584.901841:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3648:x1875323826394880:12345-0@lo:400:kworker.0 Request processed in 58us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448584.901849:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788448584.902376:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448584.902385:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826395136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448584.902448:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826395136:12345-0@lo:400:kworker.0 Request processed in 65us (7168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448584.902454:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788448584.902540:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0835d1880 x1875323826395136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448584.902554:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826395136:0@lo:400:kworker.0 00000100:00080000:3.0:1788448584.905080:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448584.905094:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448584.905096:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448584.905099:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448584.905135:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826395008:0@lo:38:kworker.0 00000100:00100000:3.0:1788448584.905194:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448584.905245:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395008 00000100:00100000:3.0:1788448584.905251:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395008 00000100:00100000:3.0:1788448584.905277:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788448584.905284:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875323826395008:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788448584.905308:0:17151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1788448584.905341:0:17151:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b804a09 00000004:00100000:3.0:1788448584.905354:0:17151:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788448584.905359:0:17151:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1788448584.905470:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826395264:0@lo:400:kworker.0 00000100:00100000:3.0:1788448584.905499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448584.928351:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395264 00000100:00100000:2.0:1788448584.928365:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395264 00000100:00100000:2.0:1788448584.928433:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448584.928443:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826395264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448584.928556:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826395264:12345-0@lo:400:kworker.0 Request processed in 114us (23054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448584.928564:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788448584.928614:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0835d2300 x1875323826395264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448584.928630:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826395264:0@lo:400:kworker.0 00000100:00100000:1.0:1788448584.935615:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826394880:0@lo:400:kworker.0 00000100:00080000:3.0:1788448584.939036:0:17151:0:(import.c:65:import_set_state_nolock()) ffff9fc183e91000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448584.939131:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826395008:12345-0@lo:38:kworker.0 Request processed in 33845us (33935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448584.939141:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788448584.939449:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788448584.939459:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788448584.939464:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788448584.939466:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb74e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788448584.939479:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e29430db): req@ffff9fc0835d0380 x1875323826387840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448584.939503:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826395008:0@lo:38:kworker.0 00000100:00100000:1.0:1788448584.939827:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448584.939842:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826395392:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448584.939918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448584.940075:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395392 00000100:00100000:2.0:1788448584.940082:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395392 00000100:00100000:2.0:1788448584.940118:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448584.940132:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826395392:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448584.940161:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788448584.940203:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826395392:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448584.940210:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448584.940488:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448584.940508:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448584.940647:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826387840 00000100:00100000:3.0:1788448584.940652:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826387840 00000100:00100000:3.0:1788448584.940672:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448584.940748:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875323826387840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448584.940897:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875323826387840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 136us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448584.940904:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448584.940933:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17187:1875323826387840:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788448584.940963:0:17187:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788448584.940994:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17187:1875323826395520:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448584.941022:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448584.941041:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448584.941050:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395520 00000100:00100000:3.0:1788448584.941053:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395520 00000100:00100000:3.0:1788448584.941067:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448584.941072:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875323826395520:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448584.941150:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875323826395520:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448584.941156:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448584.941174:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17187:1875323826395520:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448584.941228:0:17187:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17187:1875323826395648:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448584.941247:0:17187:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448584.941258:0:17187:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0823b8180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448584.941267:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395648 00000100:00100000:3.0:1788448584.941270:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395648 00000100:00100000:3.0:1788448584.941896:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448584.941906:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875323826395648:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788448584.941967:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17187:x1875323826395648:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 63us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448584.941983:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448584.942481:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826395392:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448584.946315:0:17187:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17187:1875323826395648:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788448584.946387:0:17187:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448584.948682:0:17187:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788448584.948771:0:17187:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:2.0:1788448584.948776:0:17187:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788448585.407108:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448585.871721:0:18198:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448585.872321:0:18198:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448586.431020:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788448586.916202:0:18248:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448586.916657:0:18248:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448587.454566:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448587.902575:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:1.0:1788448587.970942:0:18297:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe08c12b50 20000000:00000080:1.0:1788448587.970962:0:18297:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc187397000 uarg=0000000000000000 20000000:01000000:1.0:1788448587.971002:0:18297:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788448587.971009:0:18297:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788448587.971014:0:18297:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788448587.971924:0:18298:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788448587.975560:0:18297:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788448587.984863:0:18297:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788448587.984919:0:18297:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448587.984937:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448587.984961:0:18297:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448587.984968:0:18297:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448587.985010:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448587.985023:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448587.985038:0:18297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875323826395776:0@lo:104: 00000100:00100000:0.0:1788448587.985098:0:18297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448587.985541:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395776 00000100:00100000:2.0:1788448587.985549:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395776 00000100:00100000:2.0:1788448587.985614:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448587.985625:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:18297:x1875323826395776:12345-0@lo:104: 00010000:00010000:2.0:1788448587.985638:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448587.985700:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448587.985706:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:18297:x1875323826395776:12345-0@lo:104: Request processed in 85us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448587.985713:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788448587.986025:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448587.986033:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448587.986040:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330a00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448587.986044:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448587.986055:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448587.986063:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448587.986069:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448587.986108:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448587.986115:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448587.986145:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448587.986161:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330a00/0xf45a9e4e6b8049b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049bc expref: -99 pid: 17877 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448587.986173:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448587.986175:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448587.986176:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448587.986184:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448587.986196:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826395904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448587.986233:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448587.987404:0:18297:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448587.987420:0:18297:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448587.987432:0:18297:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875323826396032:0@lo:104: 00000100:00100000:3.0:1788448587.987472:0:18297:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448587.989829:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826395904 00000100:00100000:2.0:1788448587.989844:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826395904 00010000:00010000:2.0:1788448587.989922:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 18 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448587.989990:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448587.990002:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3648:x1875323826395904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448587.990017:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448587.990023:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 18 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448587.990036:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 18 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448587.990056:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448587.990127:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3648:x1875323826395904:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (3893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448587.990149:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448587.998585:0:18297:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc199bf6f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788448587.998656:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b8049bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8049b5 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448587.998672:0:18297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875323826395776:0@lo:104: 00000100:00100000:0.0:1788448587.999029:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396032 00000100:00100000:0.0:1788448587.999037:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396032 00000100:00100000:1.0:1788448587.999072:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826395904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448587.999098:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448587.999107:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:18297:x1875323826396032:12345-0@lo:104: 00010000:00010000:0.0:1788448587.999123:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448587.999511:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448587.999519:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:18297:x1875323826396032:12345-0@lo:104: Request processed in 413us (12047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448587.999527:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448588.000044:0:18297:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18297:1875323826396032:0@lo:104: 00010000:00010000:3.0:1788448588.000066:0:18297:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.000331:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448588.000338:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.000345:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:1.0:1788448588.000349:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.000358:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448588.000365:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448588.000371:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448588.000532:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.000557:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448588.000589:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.000596:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331800/0xf45a9e4e6b8048b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8048b9 expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.000612:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448588.000614:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448588.000616:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448588.000708:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448588.000723:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826396160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448588.000772:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448588.000993:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396160 00000100:00100000:1.0:1788448588.001000:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396160 00010000:00010000:1.0:1788448588.001027:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448588.001061:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448588.001070:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:3647:x1875323826396160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448588.001081:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448588.001086:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001097:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001112:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b8048b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8048b2 expref: 17 pid: 17140 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001125:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001265:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001282:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001289:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001295:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001301:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001307:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351fa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448588.001311:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001318:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001339:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448588.001348:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448588.001467:0:18297:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448588.001475:0:18297:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448588.001481:0:18297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a10 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18297 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448588.003728:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:3647:x1875323826396160:12345-0@lo:103:ldlm_bl.0 Request processed in 2651us (2947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448588.003742:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448588.003808:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826396160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448588.478029:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448589.502285:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788448589.887433:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448589.887442:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc187ba7000 from 13 10000000:01000000:3.0:1788448589.887447:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448589.887514:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448589.887527:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448589.887554:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448589.887581:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448589.887648:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448589.887699:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448589.887832:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396288 00000100:00100000:1.0:1788448589.887840:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396288 00000100:00100000:1.0:1788448589.887917:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788448589.887927:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+16:17142:x1875323826396288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448589.887940:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448589.888063:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804a17 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.888088:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.888100:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 17 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.888110:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd400, rc 0) 00000100:00100000:1.0:1788448589.888453:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826396288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 527us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448589.888461:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788448589.890069:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448589.890095:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448589.890107:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448589.890521:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448589.890582:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448589.890627:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196976d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448589.890674:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396416 00000100:00100000:2.0:1788448589.890680:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396416 00000100:00100000:2.0:1788448589.891985:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788448589.892008:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826396416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448589.892164:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826396416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 168us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448589.892182:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788448589.892265:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.892306:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.892350:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448589.893387:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448589.893467:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396544 00000100:00100000:3.0:1788448589.893475:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396544 00000100:00100000:3.0:1788448589.893523:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788448589.893533:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826396544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448589.893656:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826396544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448589.893663:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448589.893781:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788448589.898907:0:18371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788448589.899219:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788448589.899242:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448589.899254:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.899281:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448589.899292:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448589.899295:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc083f6b800 from 13 10000000:01000000:1.0:1788448589.899297:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448589.899408:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.899418:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.899429:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448589.899458:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.899538:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448589.899583:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448589.900231:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396672 00000100:00100000:2.0:1788448589.900240:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396672 00000100:00100000:0.0:1788448589.900458:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788448589.900470:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+17:17142:x1875323826396672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448589.900484:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448589.900511:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804a25 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448589.900535:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448589.900545:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 18 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448589.900554:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351f200, rc 0) 00000100:00100000:0.0:1788448589.901561:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826396672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1090us (2019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448589.901569:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448589.905204:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448589.905236:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.905250:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448589.905404:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.905463:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448589.905567:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448589.911241:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396800 00000100:00100000:0.0:1788448589.911258:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396800 00000100:00100000:1.0:1788448589.912066:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788448589.912081:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826396800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.912332:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826396800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (6869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448589.912340:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788448589.912732:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.912782:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448589.912836:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448589.912873:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448589.916452:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826396928 00000100:00100000:0.0:1788448589.916464:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826396928 00000100:00100000:0.0:1788448589.916520:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448589.916529:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826396928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448589.916683:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:17142:x1875323826396928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (3847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448589.916690:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448589.917733:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826396928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788448589.921197:0:18372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788448589.921284:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788448589.922050:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448589.922064:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448589.922076:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448590.014391:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448590.014426:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826397056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448590.014539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448590.014640:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826397056 00000100:00100000:3.0:1788448590.014648:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826397056 00000100:00100000:3.0:1788448590.014709:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448590.014719:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826397056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448590.014762:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788448590.014820:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826397056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448590.014828:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788448590.014901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.014906:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448590.014908:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.014911:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448590.014932:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.014936:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448590.014938:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.014941:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448590.014965:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826397312:0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.014995:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448590.015017:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448590.015023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826397440:0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.015045:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448590.015072:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826397312 00000100:00100000:3.0:1788448590.015076:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826397312 00000100:00100000:3.0:1788448590.015100:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826397440 00000100:00100000:3.0:1788448590.015103:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826397440 00000100:00100000:3.0:1788448590.015129:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448590.015137:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826397312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.015541:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826397312:12345-0@lo:400:kworker.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448590.015550:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448590.015566:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448590.015573:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826397440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.015617:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826397440:12345-0@lo:400:kworker.0 Request processed in 45us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448590.015624:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788448590.015664:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0835d2a00 x1875323826397440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448590.015677:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826397440:0@lo:400:kworker.0 00010000:00080000:3.0:1788448590.015688:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0835d0380 x1875323826397312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448590.015696:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826397312:0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.015722:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826397184:0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.015749:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448590.015779:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826397056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448590.015798:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826397184 00000100:00100000:3.0:1788448590.015802:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826397184 00000100:00100000:3.0:1788448590.015821:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448590.015828:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826397184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448590.015909:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826397184:12345-0@lo:400:kworker.0 Request processed in 81us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448590.015915:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448590.015936:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826397184:0@lo:400:kworker.0 00000100:00100000:1.0:1788448590.017570:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448579/real 1788448579] req@ffff9fc08368bb80 x1875323826391168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017597:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc08368bb80 x1875323826391168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017607:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448579/real 1788448579] req@ffff9fc083688380 x1875323826391040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448589 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017634:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc083688380 x1875323826391040/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448589 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017644:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448575/real 1788448575] req@ffff9fc08368b480 x1875323826388864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017656:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc08368b480 x1875323826388864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017664:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448575/real 1788448575] req@ffff9fc08368b800 x1875323826388992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448590 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448590.017674:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc08368b800 x1875323826388992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448590 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448590.017690:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448590.017701:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448590.017705:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826391168:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788448590.017710:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448590.017715:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448590.017718:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826391040:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788448590.017722:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448590.017726:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448590.017729:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388864:0@lo:8:kworker.0 00000100:00080000:1.0:1788448590.017733:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448590.017737:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448590.017739:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826388992:0@lo:8:kworker.0 00000100:00080000:3.0:1788448590.018657:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.018662:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788448590.018664:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448590.018677:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1788448590.018682:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788448590.018688:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc082765000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448590.018724:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d0700 x1875323826397696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448590.018736:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.018739:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448590.018740:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448590.018743:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 493 00000100:00080000:3.0:1788448590.018745:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788448590.018748:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc187ba0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448590.018757:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d3480 x1875323826397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448590.018765:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.018767:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788448590.018769:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448590.018772:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 497 00000100:00080000:3.0:1788448590.018774:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448590.018777:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc185684000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448590.018785:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0835d2a00 x1875323826397952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448590.018792:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448590.018795:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448590.018796:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448590.018798:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 497 00000100:00080000:3.0:1788448590.018806:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448590.018809:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc190ac4000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448590.018821:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e8000 x1875323826398080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448590.018839:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448590.018850:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826397568:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788448590.018925:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448590.018963:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826397568 00000100:00100000:3.0:1788448590.018970:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826397568 00000100:00100000:3.0:1788448590.019008:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448590.019016:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826397568:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448590.019048:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448590.019139:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3646:x1875323826397568:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448590.019146:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448590.019284:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826397696:0@lo:8:kworker.0 00000400:00000100:1.0:1788448590.019320:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826397696 offset 0 length 520: 4 00000100:00100000:1.0:1788448590.019343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826397824:0@lo:8:kworker.0 00000400:00000100:1.0:1788448590.019355:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826397824 offset 0 length 520: 4 00000100:00100000:1.0:1788448590.019374:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826397952:0@lo:8:kworker.0 00000400:00000100:1.0:1788448590.019391:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826397952 offset 0 length 520: 4 00000100:00100000:1.0:1788448590.019399:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826398080:0@lo:8:kworker.0 00000400:00000100:1.0:1788448590.019413:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323826398080 offset 0 length 520: 4 00000100:00100000:3.0:1788448590.022716:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826397568:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788448590.526737:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448590.528171:0:17878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1788448591.039924:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448591.550146:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448592.576122:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448593.600004:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448594.623257:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448595.134276:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.134283:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.134286:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.134290:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.134306:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.134310:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.134327:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.134330:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448595.135047:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826398208:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.135120:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.135176:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826398720:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.135202:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.135226:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448595.135232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826398592:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.135277:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.135311:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826398336:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.135334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.135350:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826398848:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448595.135367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.135378:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448595.135383:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826398464:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.135402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.135431:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398208 00000100:00100000:3.0:1788448595.135438:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398208 00000100:00100000:3.0:1788448595.135493:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788448595.135502:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3646:x1875323826398208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.135546:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:3646:x1875323826398208:12345-0@lo:400:kworker.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.135554:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448595.135738:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826398976:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448595.135765:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.136193:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398720 00000100:00100000:3.0:1788448595.136200:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398720 00000100:00100000:3.0:1788448595.136285:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398464 00000100:00100000:3.0:1788448595.136289:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398464 00000100:00100000:0.0:1788448595.136329:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448595.136338:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826398720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448595.136382:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826398720:12345-0@lo:400:kworker.0 Request processed in 45us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.136401:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448595.136415:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448595.136420:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826398464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448595.136451:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826398464:12345-0@lo:400:kworker.0 Request processed in 30us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.136467:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788448595.136504:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0836ea680 x1875323826398464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448595.136519:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826398464:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.136779:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398592 00000100:00100000:3.0:1788448595.136785:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398592 00000100:00100000:3.0:1788448595.137061:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398336 00000100:00100000:3.0:1788448595.137066:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398336 00000100:00100000:3.0:1788448595.137079:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398848 00000100:00100000:3.0:1788448595.137082:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398848 00000100:00100000:3.0:1788448595.137091:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826398976 00000100:00100000:3.0:1788448595.137094:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826398976 00000100:00100000:3.0:1788448595.137104:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448595.137110:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826398592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.137155:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826398592:12345-0@lo:400:kworker.0 Request processed in 45us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.137161:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448595.137174:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448595.137180:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.137258:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1875323826398336:12345-0@lo:400:kworker.0 Request processed in 78us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.137265:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448595.137276:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788448595.137283:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826398848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448595.137310:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788448595.137342:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826398848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.137348:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788448595.137360:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788448595.137366:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826398976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448595.137409:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448595.137444:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826398976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.137450:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788448595.137508:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826398592:0@lo:400:kworker.0 00000100:00100000:3.0:1788448595.137521:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826398208:0@lo:400:kworker.0 00010000:00080000:3.0:1788448595.137534:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0836e9180 x1875323826398720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448595.137546:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826398720:0@lo:400:kworker.0 00000100:00100000:0.0:1788448595.138043:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826398336:0@lo:400:kworker.0 00000100:00100000:0.0:1788448595.138066:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826398848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448595.138101:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826398976:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1788448595.232312:0:18645:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448595.232315:0:18645:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788448595.232316:0:18645:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788448595.232436:0:18645:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc183e97800 00000020:01000004:3.0:1788448595.232453:0:18645:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788448595.232474:0:18645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788448595.232489:0:18645:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9fc1ba05b370) 00000020:00000080:3.0:1788448595.235493:0:18645:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788448595.312703:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788448595.313640:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788448595.315553:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788448595.316568:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788448595.317102:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788448595.317585:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788448595.318097:0:18645:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788448595.322120:0:18645:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788448595.322324:0:18645:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788448595.322348:0:18645:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788448595.322359:0:18645:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45a9e4e6b804a3a 00000020:01000004:3.0:1788448595.322366:0:18645:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788448595.322387:0:18645:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788448595.322401:0:18645:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788448595.322407:0:18645:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788448595.322412:0:18645:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788448595.322423:0:18645:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9fc1ba0599b8) 00000020:00000080:3.0:1788448595.322434:0:18645:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788448595.328745:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448595.329096:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448595.329103:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788448595.336589:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448595.336603:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788448595.337174:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448595.337181:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788448595.339081:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448595.339571:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788448595.339577:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788448595.340305:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788448595.340312:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788448595.381357:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448595.381586:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788448595.381593:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788448595.385359:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448595.385374:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788448595.388575:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788448595.388591:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788448595.396100:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448595.396288:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788448595.396294:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788448595.397275:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788448595.397287:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788448595.466298:0:18645:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448595.466552:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788448595.466559:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788448595.472239:0:18645:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788448595.472255:0:18645:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788448595.473070:0:18645:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788448595.473097:0:18645:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788448595.473103:0:18645:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788448595.492491:0:18645:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448595.492537:0:18645:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.121@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788448595.492542:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448595.492544:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448595.492545:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448595.492547:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448595.492548:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448595.492549:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448595.492551:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448595.492553:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448595.492554:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448595.492558:0:18645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788448595.492560:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448595.492562:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448595.492563:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448595.492564:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448595.492565:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448595.492566:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448595.492567:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448595.492568:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448595.492575:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448595.492600:0:18645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788448595.492619:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399104:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448595.492685:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.492946:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.493292:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399104 00000100:00100000:0.0:1788448595.493299:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399104 00000100:00100000:0.0:1788448595.493451:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788448595.493472:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:18645:x1875323826399104:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448595.493511:0:17138:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788448595.493514:0:17138:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788448595.493518:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788448595.494126:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:18645:x1875323826399104:12345-0@lo:253:mount.lustre.0 Request processed in 578us (1362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.494134:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448595.494398:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399104:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448595.494409:0:18645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788448595.494411:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448595.494413:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448595.494414:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448595.494415:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448595.494416:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448595.494417:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448595.494419:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448595.494420:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448595.494421:0:18645:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448595.494437:0:18645:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc183e97800 from lustre-OST0000 10000000:01000000:2.0:1788448595.494472:0:18645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788448595.494475:0:18645:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788448595.494481:0:18645:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc1bb53cd28 local copy 00010000:00010000:2.0:1788448595.494491:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448595.494579:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448595.494611:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.494677:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.494710:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399232 00000100:00100000:0.0:1788448595.494715:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399232 00000100:00100000:0.0:1788448595.494849:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788448595.494858:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:18645:x1875323826399232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448595.494959:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:18645:x1875323826399232:12345-0@lo:501:mount.lustre.0 Request processed in 102us (347us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448595.494965:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788448595.495094:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399232:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448595.495106:0:18645:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788448595.495123:0:18645:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788448595.495129:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.495144:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448595.495180:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc183e97800 10000000:01000000:2.0:1788448595.495185:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448595.495189:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788448595.495192:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448595.495196:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788448595.495198:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448595.495229:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.495238:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.495246:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448595.495257:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448595.495283:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.496271:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448595.496486:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399360 00000100:00100000:3.0:1788448595.496494:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399360 00000100:00100000:1.0:1788448595.496671:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448595.496681:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+18:18645:x1875323826399360:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448595.496706:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448595.496722:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b804a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804a48 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.496757:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b804a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a48 expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.496767:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fd200/0xf45a9e4e6b804a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a48 expref: 19 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.496775:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd200, rc 0) 00000100:00100000:1.0:1788448595.496828:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399360:12345-0@lo:101:mount.lustre.0 Request processed in 149us (1544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448595.496835:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788448595.496921:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448595.496936:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.496946:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448595.498698:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788448595.499544:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448595.502551:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788448595.502601:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788448595.502630:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788448595.502645:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788448595.502656:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788448595.502668:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788448595.502692:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788448595.502698:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788448595.502821:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448595.502928:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.502961:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448595.503204:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399488 00000100:00100000:1.0:1788448595.503222:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399488 00000100:00100000:1.0:1788448595.503272:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448595.503283:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399488:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448595.503420:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399488:12345-0@lo:501:mount.lustre.0 Request processed in 138us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448595.503428:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788448595.503709:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399488:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448595.503743:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399616:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448595.503782:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.503836:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908603c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448595.503863:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399616 00000100:00100000:1.0:1788448595.503868:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399616 00000100:00100000:1.0:1788448595.504284:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448595.504293:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399616:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448595.504969:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399616:12345-0@lo:503:mount.lustre.0 Request processed in 675us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448595.504987:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448595.505100:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399616:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448595.505506:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448595.505583:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448595.505621:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.506353:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.506587:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399744 00000100:00100000:0.0:1788448595.506596:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399744 00000100:00100000:3.0:1788448595.506641:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788448595.506654:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399744:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448595.507372:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399744:12345-0@lo:502:mount.lustre.0 Request processed in 719us (1748us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.507381:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448595.507580:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448595.508032:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788448595.508065:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788448595.508092:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788448595.508105:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788448595.508117:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788448595.508132:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788448595.508144:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788448595.508155:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788448595.508168:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788448595.508197:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788448595.508213:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788448595.508226:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788448595.508258:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399872:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448595.508311:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448595.508500:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.508540:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826399872 00000100:00100000:0.0:1788448595.508546:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826399872 00000100:00100000:0.0:1788448595.508586:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788448595.508595:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399872:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448595.508732:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826399872:12345-0@lo:502:mount.lustre.0 Request processed in 137us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.508755:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448595.509033:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826399872:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448595.509077:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788448595.509085:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788448595.511564:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788448595.511575:0:18662:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788448595.511581:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448595.511583:0:18662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788448595.511590:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448595.511604:0:18662:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9fc1bb53b370) 00000020:00000080:0.0:1788448595.511629:0:18662:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788448595.511633:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788448595.512143:0:18662:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc183e97800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788448595.512152:0:18662:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788448595.512158:0:18662:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf45a9e4e6b804a5d 00010000:00010000:1.0:1788448595.520562:0:18662:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788448595.521256:0:18662:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788448595.522700:0:18662:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788448595.524360:0:18662:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788448595.524372:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448595.524379:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448595.524381:0:18662:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788448595.524386:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788448595.524388:0:18662:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788448595.524389:0:18662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448595.524391:0:18662:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448595.524392:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788448595.524394:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448595.524396:0:18662:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788448595.524398:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448595.524407:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448595.524408:0:18662:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788448595.524411:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788448595.524413:0:18662:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788448595.524415:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448595.524418:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448595.524419:0:18662:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788448595.524421:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448595.524424:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448595.524425:0:18662:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788448595.524428:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788448595.524467:0:18662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448595.524472:0:18662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448595.524473:0:18662:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788448595.524476:0:18662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788448595.526408:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788448595.526454:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788448595.526519:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.526532:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331400/0xf45a9e4e6b804a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a4f expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448595.526540:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc183e97800 from 1 10000000:01000000:1.0:1788448595.526542:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448595.526578:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.526586:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.526597:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448595.526621:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400000:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788448595.526681:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.526730:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448595.526839:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400000 00000100:00100000:3.0:1788448595.526847:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400000 00000100:00100000:3.0:1788448595.526910:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448595.526920:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:18645:x1875323826400000:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448595.526941:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448595.526953:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804a64 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.526974:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.526984:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.526992:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1fc00, rc 0) 00000100:00100000:3.0:1788448595.527029:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400000:12345-0@lo:101:mount.lustre.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.527048:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448595.529695:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400000:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448595.529733:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448595.529754:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448595.532575:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788448595.533057:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448595.533244:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788448595.533271:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788448595.533290:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788448595.533294:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788448595.533526:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448595.533595:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.533648:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448595.534147:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400128 00000100:00100000:2.0:1788448595.534155:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400128 00000100:00100000:2.0:1788448595.534209:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788448595.534218:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400128:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448595.536691:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400128:12345-0@lo:501:mount.lustre.0 Request processed in 2466us (3089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448595.536708:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448595.536795:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400128:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448595.537206:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400256:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448595.537345:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.537391:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.537449:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400256 00000100:00100000:0.0:1788448595.537470:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400256 00000100:00100000:0.0:1788448595.537513:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788448595.537522:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448595.537632:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400256:12345-0@lo:503:mount.lustre.0 Request processed in 111us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.537640:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788448595.539448:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400256:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788448595.540377:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448595.540476:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400384:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448595.540549:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.540591:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448595.540593:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400384 00000100:00100000:3.0:1788448595.540600:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400384 00000100:00100000:3.0:1788448595.540638:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448595.540648:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400384:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448595.541014:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400384:12345-0@lo:502:mount.lustre.0 Request processed in 366us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.541022:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788448595.541177:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400384:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448595.541523:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788448595.541549:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788448595.541562:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788448595.541582:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788448595.541594:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788448595.541604:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788448595.541615:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788448595.541628:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:1.0:1788448595.541641:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788448595.541653:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:1.0:1788448595.541665:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:1.0:1788448595.541699:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448595.541739:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.541820:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08355dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.542013:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400512 00000100:00100000:0.0:1788448595.542019:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400512 00000100:00100000:1.0:1788448595.542227:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788448595.542237:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400512:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448595.542451:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400512:12345-0@lo:502:mount.lustre.0 Request processed in 214us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448595.542473:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448595.542530:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400512:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448595.542581:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788448595.542590:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788448595.543385:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448595.543396:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.543404:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788448595.543410:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc183e97800 00000020:00000080:2.0:1788448595.543413:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448595.543420:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448595.543422:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.543424:0:18666:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788448595.543426:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448595.543429:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.543430:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788448595.543433:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc183e97800 00000020:00000080:2.0:1788448595.543435:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448595.543533:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448595.543537:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.543538:0:18666:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788448595.543541:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448595.543543:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.543544:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788448595.543547:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc183e97800 00000020:00000080:2.0:1788448595.543549:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448595.547262:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448595.547275:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.547277:0:18666:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788448595.547281:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448595.547286:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.547287:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788448595.547298:0:18666:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc183e97800 00000020:00000080:2.0:1788448595.547300:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448595.547376:0:18666:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448595.547380:0:18666:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448595.547382:0:18666:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788448595.547385:0:18666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788448595.550442:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788448595.550496:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448595.550517:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.550528:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448595.550621:0:18645:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788448595.550624:0:18645:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc183e97800 10000000:01000000:0.0:1788448595.550627:0:18645:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc183e97800 10000000:01000000:0.0:1788448595.550631:0:18645:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448595.550636:0:18645:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc183e97800 from 1 10000000:01000000:0.0:1788448595.550639:0:18645:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448595.550678:0:18645:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.550687:0:18645:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.550699:0:18645:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448595.550727:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448595.550805:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.550846:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400640 00000100:00100000:0.0:1788448595.550853:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400640 00000100:00100000:0.0:1788448595.551206:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788448595.551219:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:18645:x1875323826400640:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448595.551232:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448595.551245:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804a72 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.551338:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a72 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.551362:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc08351fa00/0xf45a9e4e6b804a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a72 expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.551371:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc08351fa00, rc 0) 00000100:00100000:0.0:1788448595.551406:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826400640:12345-0@lo:101:mount.lustre.0 Request processed in 191us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.551413:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788448595.551468:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.551489:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448595.551501:0:18645:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.551510:0:18645:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448595.553641:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788448595.557634:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448595.558967:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788448595.559006:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788448595.559018:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788448595.559029:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788448595.559059:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788448595.559072:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788448595.559098:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788448595.559110:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788448595.559121:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788448595.559136:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788448595.559163:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788448595.559182:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788448595.559193:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788448595.559204:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788448595.559215:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788448595.559226:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788448595.559238:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788448595.559248:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788448595.559259:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788448595.559272:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788448595.559284:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788448595.559296:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788448595.559308:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788448595.559323:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788448595.559351:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788448595.559367:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788448595.559404:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788448595.559421:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788448595.559434:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788448595.559448:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788448595.559474:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788448595.559488:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788448595.559500:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788448595.559512:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788448595.559525:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788448595.559538:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788448595.559551:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788448595.559574:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788448595.559579:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788448595.559670:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448595.559732:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.559777:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400768 00000100:00100000:0.0:1788448595.559780:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448595.559785:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400768 00000100:00100000:1.0:1788448595.559831:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788448595.559841:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826400768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448595.559969:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826400768:12345-0@lo:501:mount.lustre.0 Request processed in 128us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448595.559977:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448595.560149:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448595.560184:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448595.560220:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.560241:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826400896 00000100:00100000:0.0:1788448595.560245:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826400896 00000100:00100000:0.0:1788448595.560273:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788448595.560279:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826400896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448595.560359:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826400896:12345-0@lo:503:mount.lustre.0 Request processed in 79us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.560366:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788448595.560401:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.560413:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826400896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788448595.560740:0:18645:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448595.560792:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448595.561257:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.561284:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401024 00000100:00100000:0.0:1788448595.561289:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401024 00000100:00100000:0.0:1788448595.561322:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448595.561431:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401024:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448595.561538:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401024:12345-0@lo:502:mount.lustre.0 Request processed in 209us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.561545:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448595.561583:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.561596:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448595.562232:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788448595.562261:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788448595.562286:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788448595.562298:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788448595.562310:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788448595.562322:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788448595.565901:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788448595.565963:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788448595.565979:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788448595.565994:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788448595.566007:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788448595.566021:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788448595.566045:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788448595.566181:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788448595.566196:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788448595.566209:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788448595.566221:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788448595.566236:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788448595.566265:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788448595.566281:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788448595.566296:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788448595.566308:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788448595.566321:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788448595.566405:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788448595.566422:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788448595.566434:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788448595.566445:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788448595.566469:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788448595.566483:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788448595.566495:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788448595.566506:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788448595.566517:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788448595.566528:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788448595.566539:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788448595.566562:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788448595.566582:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788448595.566593:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788448595.566607:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788448595.566618:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788448595.566629:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788448595.566639:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788448595.566648:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788448595.566658:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788448595.566670:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788448595.566681:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788448595.566691:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788448595.566701:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788448595.566711:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788448595.566765:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448595.566902:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.566944:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401152 00000100:00100000:0.0:1788448595.566951:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401152 00000100:00100000:0.0:1788448595.567002:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788448595.567012:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401152:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448595.568950:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.569726:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401152:12345-0@lo:502:mount.lustre.0 Request processed in 2710us (2819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.569738:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788448595.570028:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401152:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448595.570242:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788448595.570268:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788448595.570311:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401280:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448595.570359:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448595.570402:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc191c7b600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.570620:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401280 00000100:00100000:0.0:1788448595.570627:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401280 00000100:00100000:0.0:1788448595.570671:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788448595.570681:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448595.570767:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401280:12345-0@lo:502:mount.lustre.0 Request processed in 87us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.570775:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788448595.572471:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401280:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448595.572551:0:18645:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788448595.572563:0:18645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788448595.574928:0:18672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788448595.575132:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9fc1ba058000) 00000020:00000080:3.0:1788448595.575156:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788448595.575254:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc183e97800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448595.575258:0:18672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc183e97800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448595.575273:0:18672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc183e97800 3 00010000:00080000:3.0:1788448595.575301:0:18672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc0835ec000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448595.578670:0:18672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788448595.579162:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788448595.579206:0:18672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788448595.579218:0:18672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf45a9e4e6b804a87 00000100:00080000:3.0:1788448595.579228:0:18672:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448595.579233:0:18672:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9fc0835ec000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448595.579448:0:18672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e9180 x1875323826401408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448595.579483:0:18672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788448595.579507:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.579511:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.579519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.579522:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.579525:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.579528:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.579530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448595.579533:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788448595.579967:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826401408:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788448595.580049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.580105:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401408 00000100:00100000:0.0:1788448595.580112:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401408 00000100:00100000:0.0:1788448595.580140:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448595.580147:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875323826401408:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788448595.580170:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:0.0:1788448595.580197:0:17145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf45a9e4e6b804a8e 00000004:00100000:0.0:1788448595.580210:0:17145:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788448595.580239:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9fc0831ce800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448595.580285:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875323826401408:12345-0@lo:38:llog_process_th.0 Request processed in 137us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.580293:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788448595.580327:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0836e9180 x1875323826401408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448595.581135:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448595.581144:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1788448595.581152:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788448595.581162:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788448595.581165:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788448595.581172:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875323826401408:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788448595.582041:0:18672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788448595.582065:0:18672:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9fc1ba05cd28) 00000020:00000080:3.0:1788448595.582086:0:18672:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788448595.582171:0:18672:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc183e97800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448595.582175:0:18672:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc183e97800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448595.582178:0:18672:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc183e97800 3 00010000:00080000:3.0:1788448595.582213:0:18672:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc0835e9000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.121@tcp at head 00010000:00010000:3.0:1788448595.587517:0:18672:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788448595.587699:0:18672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788448595.587740:0:18672:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788448595.587752:0:18672:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xf45a9e4e6b804a9c 00000100:00080000:3.0:1788448595.587762:0:18672:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448595.587767:0:18672:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9fc0835e9000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448595.589917:0:18672:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e8a80 x1875323826401536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448595.590165:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826401536:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788448595.590229:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448595.591328:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401536 00000100:00100000:3.0:1788448595.591339:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401536 00000100:00100000:3.0:1788448595.591384:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448595.591391:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826401536:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788448595.591417:0:17147:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 512 last 0 00000020:00000080:3.0:1788448595.591470:0:17147:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xf45a9e4e6b804aa3 00000100:00080000:0.0:1788448595.592966:0:18672:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000004:00100000:3.0:1788448595.593013:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788448595.593067:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448595.593072:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448595.593075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448595.593078:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448595.593081:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448595.593084:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448595.593087:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448595.593089:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448595.593120:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ed800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448595.593198:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875323826401536:12345-0@lo:38:llog_process_th.0 Request processed in 1805us (2967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.593208:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788448595.593430:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9fc0836e8a80 x1875323826401536/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448595.593442:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788448595.593449:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788448595.593466:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788448595.593471:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788448595.593473:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc0835e9000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788448595.593479:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875323826401536:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788448595.593603:0:18672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788448595.593724:0:18645:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788448595.593750:0:18645:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448595.593768:0:18645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.593789:0:18645:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351ee00/0xf45a9e4e6b804a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804a79 expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788448595.593832:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788448595.593834:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448595.593835:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448595.593836:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448595.593837:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448595.593839:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448595.593840:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448595.593842:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448595.593843:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448595.593847:0:18645:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788448595.593849:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448595.593850:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448595.593851:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448595.593852:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448595.593853:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448595.593854:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448595.593855:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448595.593856:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448595.593857:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448595.593874:0:18645:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788448595.593936:0:18645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401664:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448595.593980:0:18645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.594007:0:18645:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082548600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.594024:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401664 00000100:00100000:0.0:1788448595.594029:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401664 00000100:00100000:0.0:1788448595.594077:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788448595.594085:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448595.594107:0:17140:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448595.594120:0:17140:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448595.600511:0:17140:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448595.600526:0:17140:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788448595.600878:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:18645:x1875323826401664:12345-0@lo:253:mount.lustre.0 Request processed in 6788us (6892us total) trans 0 rc 0/0 20000000:01000000:2.0:1788448595.600893:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448595.600898:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:0.0:1788448595.600902:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:2.0:1788448595.600917:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.600939:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 20 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.600947:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.600955:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.600999:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 20 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448595.601000:0:18645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:18645:1875323826401664:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788448595.601012:0:18645:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00010000:00010000:2.0:1788448595.601013:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 20 pid: 17140 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788448595.601015:0:18645:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448595.601017:0:18645:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788448595.601018:0:18645:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448595.601019:0:18645:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448595.601020:0:18645:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448595.601022:0:18645:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448595.601023:0:18645:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000100:00100000:2.0:1788448595.601025:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826401792:0@lo:104: 00000020:01000004:1.0:1788448595.601025:0:18645:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448595.601027:0:18645:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:2.0:1788448595.601067:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448595.601109:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 20 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.601117:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 20 pid: 17139 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448595.601124:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826401920:0@lo:104: 00000100:00100000:2.0:1788448595.601147:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:02000000:1.0:1788448595.601156:0:18645:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788448595.601178:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448595.601478:0:17128:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788448595.601492:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401792 00000100:00100000:0.0:1788448595.601497:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401792 00000100:00100000:0.0:1788448595.601522:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826401920 00000100:00100000:0.0:1788448595.601525:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826401920 00000100:00100000:0.0:1788448595.601535:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448595.601543:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:17161:x1875323826401792:12345-0@lo:104: 00010000:00010000:0.0:1788448595.601554:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601612:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448595.601617:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:17161:x1875323826401792:12345-0@lo:104: Request processed in 76us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.601623:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448595.601638:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448595.601644:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b72bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826401920:12345-0@lo:104: 00010000:00010000:0.0:1788448595.601651:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601684:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448595.601689:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b72bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826401920:12345-0@lo:104: Request processed in 46us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.601695:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788448595.601744:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448595.601755:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601762:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448595.601765:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601773:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448595.601779:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448595.601784:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448595.601813:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601819:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448595.601837:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601843:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b8049fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a02 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601855:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448595.601858:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601862:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ea00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448595.601865:0:17133:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601902:0:17133:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448595.601909:0:17133:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448595.601914:0:17133:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448595.601929:0:17133:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601935:0:17133:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448595.601941:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601947:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351ea00/0xf45a9e4e6b8049ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b8049f4 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.601959:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448595.601961:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448595.601963:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448595.601978:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826402048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448595.602005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.602025:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448595.602031:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826402176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448595.602610:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826401792:0@lo:104: 00000100:00100000:2.0:1788448595.602621:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826401920:0@lo:104: 00010000:00010000:2.0:1788448595.602647:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448595.603124:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448595.603185:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402048 00000100:00100000:0.0:1788448595.603191:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402048 00010000:00010000:0.0:1788448595.603215:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 21 pid: 17140 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448595.603252:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402176 00000100:00100000:0.0:1788448595.603256:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402176 00010000:00010000:3.0:1788448595.603259:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448595.603269:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 22 pid: 17139 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448595.603283:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448595.603287:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448595.603289:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3645:x1875323826402048:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448595.603294:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19203a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3645:x1875323826402176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448595.603300:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448595.603300:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448595.603305:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 22 pid: 17140 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.603306:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 22 pid: 17139 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.603316:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 22 pid: 17140 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.604625:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 22 pid: 17139 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605257:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152f800/0xf45a9e4e6b8049f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8049ed expref: 22 pid: 17139 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605276:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605284:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788448595.605300:0:17132:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004403396s 00010000:00010000:3.0:1788448595.605305:0:17132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605313:0:17132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605320:0:17132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605327:0:17132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605333:0:17132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0331c00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448595.605338:0:17132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605345:0:17132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605361:0:17132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605378:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448595.605438:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19203a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3645:x1875323826402176:12345-0@lo:103:ldlm_bl.0 Request processed in 2143us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448595.605448:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788448595.605492:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605500:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448595.605506:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804aaa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448595.605607:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826402176:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448595.608756:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b8049fb expref: 20 pid: 17140 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448595.608782:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448595.608878:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:3645:x1875323826402048:12345-0@lo:103:ldlm_bl.0 Request processed in 5586us (6870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448595.608906:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448595.609104:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826402048:0@lo:103:ldlm_bl.0 00000001:00000004:1.0:1788448595.609637:0:18645:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788448595.615003:0:18645:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788448595.615013:0:18645:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788448595.615049:0:18645:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788448595.615092:0:18645:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788448595.615110:0:18645:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788448595.615139:0:18645:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788448595.616022:0:18645:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448595.616234:0:18645:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788448595.646968:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788448596.566317:0:18725:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788448596.566575:0:18725:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448596.674234:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448597.118746:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788448597.377382:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448597.377390:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc187ba7000 from 9 10000000:01000000:2.0:1788448597.377396:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448597.377442:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448597.378422:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448597.378434:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448597.378474:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448597.378609:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448597.378718:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448597.378959:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402304 00000100:00100000:1.0:1788448597.378968:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402304 00000100:00100000:1.0:1788448597.379019:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788448597.379028:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+19:17142:x1875323826402304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448597.379042:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448597.379059:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804ab1 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.379193:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.379205:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 20 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.379215:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fdc00, rc 0) 00000100:00100000:1.0:1788448597.379256:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:17142:x1875323826402304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 229us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448597.379262:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788448597.379473:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448597.379488:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448597.379579:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448597.379701:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402432:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788448597.379735:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448597.379765:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448597.379809:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402432 00000100:00100000:1.0:1788448597.379814:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402432 00000100:00100000:1.0:1788448597.379972:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448597.379981:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:17142:x1875323826402432:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788448597.379996:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788448597.380011:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788448597.380014:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1788448597.380107:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:17142:x1875323826402432:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448597.380114:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788448597.380993:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402432:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788448597.381063:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448597.381071:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448597.381080:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448597.381089:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788448597.381091:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6b800 from 9 10000000:01000000:3.0:1788448597.381094:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448597.381122:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448597.381129:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448597.381138:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448597.381153:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448597.381199:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448597.381230:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0320c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448597.381230:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402560 00000100:00100000:1.0:1788448597.381235:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402560 00000100:00100000:1.0:1788448597.381267:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788448597.381276:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:17142:x1875323826402560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448597.381285:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448597.381295:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804abf expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.381313:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.381322:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.381329:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc800, rc 0) 00000100:00100000:1.0:1788448597.381362:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826402560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448597.381369:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788448597.381401:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448597.381411:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.381419:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448597.381471:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788448597.381603:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448597.381797:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1928c4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788448597.381967:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402688 00000100:00100000:2.0:1788448597.381972:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402688 00000100:00100000:2.0:1788448597.382034:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448597.382042:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826402688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788448597.382055:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448597.382068:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448597.382070:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788448597.382263:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826402688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 221us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448597.382270:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788448597.382319:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826402688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788448597.382367:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788448597.382374:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448597.382382:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448597.696197:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448598.718961:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448599.746142:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448600.256122:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826402816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448600.256189:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.258110:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402816 00000100:00100000:2.0:1788448600.258120:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402816 00000100:00100000:2.0:1788448600.258169:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448600.258180:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826402816:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788448600.258217:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788448600.258289:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826402816:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (2099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.258296:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448600.261036:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826402944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448600.261114:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448600.261211:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826402816:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448600.261241:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826402944 00000100:00100000:0.0:1788448600.261246:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826402944 00000100:00100000:0.0:1788448600.261289:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448600.261298:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826402944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448600.261329:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788448600.261374:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826402944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448600.261382:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788448600.261415:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826402944:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788448600.767360:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448600.767366:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448600.767376:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448600.767380:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448600.767408:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448600.767412:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448600.767414:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448600.767417:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788448600.767470:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826403200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767535:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767574:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767626:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448600.767631:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826403072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767659:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767680:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826403584:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767701:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767729:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826403328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767770:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826403840:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448600.767810:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826403456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.767833:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448600.767866:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403200 00000100:00100000:2.0:1788448600.767878:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403200 00000100:00100000:2.0:1788448600.767931:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403456 00000100:00100000:2.0:1788448600.767934:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403456 00000100:00100000:2.0:1788448600.767948:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448600.767957:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826403200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.768544:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826403200:12345-0@lo:400:kworker.0 Request processed in 586us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.768552:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448600.768573:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788448600.768581:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826403456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.768613:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826403456:12345-0@lo:400:kworker.0 Request processed in 34us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.768619:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788448600.768640:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403712 00000100:00100000:2.0:1788448600.768644:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403712 00000100:00100000:2.0:1788448600.768669:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403584 00000100:00100000:2.0:1788448600.768672:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403584 00000100:00100000:2.0:1788448600.768681:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403328 00000100:00100000:2.0:1788448600.768683:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403328 00000100:00100000:2.0:1788448600.768694:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403840 00000100:00100000:2.0:1788448600.768696:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403840 00000100:00100000:2.0:1788448600.768709:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448600.768715:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826403712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.768745:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826403712:12345-0@lo:400:kworker.0 Request processed in 30us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.768751:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448600.768764:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448600.768771:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826403584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.768808:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826403584:12345-0@lo:400:kworker.0 Request processed in 39us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.768815:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448600.768826:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448600.768832:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826403328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.768858:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826403328:12345-0@lo:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.768864:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448600.768875:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788448600.768936:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448600.768940:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788448600.768968:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7ca300 x1875323826403584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448600.768981:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826403584:0@lo:400:kworker.0 00000100:00100000:3.0:1788448600.768995:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826403200:0@lo:400:kworker.0 00010000:00080000:3.0:1788448600.769008:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7c8380 x1875323826403712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448600.769016:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.769767:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826403840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448600.769824:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826403840:12345-0@lo:400:kworker.0 Request processed in 943us (2030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448600.769832:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448600.769960:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826403456:0@lo:400:kworker.0 00010000:00080000:2.0:1788448600.769976:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7ca680 x1875323826403328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448600.769986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826403328:0@lo:400:kworker.0 00010000:00080000:2.0:1788448600.769996:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7cad80 x1875323826403840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448616 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448600.770004:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826403840:0@lo:400:kworker.0 00000100:00100000:1.0:1788448600.771873:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403072 00000100:00100000:1.0:1788448600.771898:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403072 00000100:00100000:1.0:1788448600.771948:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788448600.771958:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3646:x1875323826403072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448600.772045:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3646:x1875323826403072:12345-0@lo:400:kworker.0 Request processed in 87us (4384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448600.772053:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788448600.772109:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826403072:0@lo:400:kworker.0 00010000:00010000:3.0:1788448600.773136:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448601.285833:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448601.792752:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448601.946763:0:19014:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788448602.814872:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448603.010934:0:19067:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448603.011140:0:19067:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788448603.838105:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788448604.211989:0:19117:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448604.212795:0:19117:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788448604.871512:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448605.376260:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826403968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448605.376335:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.376456:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826403968 00000100:00100000:1.0:1788448605.376464:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826403968 00000100:00100000:1.0:1788448605.376526:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448605.376535:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826403968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448605.376580:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448605.376636:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826403968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448605.376643:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448605.376686:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08368b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826403968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448605.379053:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448605.381874:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826404096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448605.381989:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.382138:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404096 00000100:00100000:1.0:1788448605.382146:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404096 00000100:00100000:1.0:1788448605.382195:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448605.382205:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826404096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448605.382238:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788448605.382732:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826404096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 527us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448605.382741:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448605.382813:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826404096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448605.822050:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448590/real 1788448590] req@ffff9fc0835d2a00 x1875323826397952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448605 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448605.822079:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc0835d2a00 x1875323826397952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448605 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448605.822090:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448590/real 1788448590] req@ffff9fc0836e8000 x1875323826398080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448605 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448605.822100:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc0836e8000 x1875323826398080/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448605 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448605.822119:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448605.822144:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448605.822163:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826397952:0@lo:8:kworker.0 00000100:00080000:1.0:1788448605.822169:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448605.822174:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448605.822176:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826398080:0@lo:8:kworker.0 00000100:00080000:0.0:1788448605.822343:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448605.822348:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448605.822363:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448605.822366:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788448605.822383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448605.822386:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788448605.822388:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448605.822393:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1788448605.822415:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448605.822422:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9fc185684000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448605.822443:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137c000 x1875323826404736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448605.822459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448605.822462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448605.822464:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448605.822467:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1788448605.822469:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448605.822473:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc190ac4000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448605.822484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc19137f100 x1875323826404864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448605.822523:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826404480:0@lo:400:kworker.0 00000100:00100000:0.0:1788448605.822584:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448605.822611:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826405248:0@lo:400:kworker.0 00000100:00100000:0.0:1788448605.822632:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448605.822646:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788448605.822651:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826404352:0@lo:400:kworker.0 00000100:00100000:0.0:1788448605.822671:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448605.822695:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826405120:0@lo:400:kworker.0 00000100:00100000:0.0:1788448605.822710:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448605.822738:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404352 00000100:00100000:0.0:1788448605.822744:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404352 00000100:00100000:0.0:1788448605.822778:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448605.822785:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448605.822840:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826404352:12345-0@lo:400:kworker.0 Request processed in 54us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448605.822847:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448605.822959:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826404608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448605.822984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.822998:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788448605.823002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826404224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448605.823023:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.823040:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826404992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448605.823059:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.823089:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404608 00000100:00100000:1.0:1788448605.823092:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404608 00000100:00100000:1.0:1788448605.823111:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448605.823116:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826404608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448605.823146:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826404608:12345-0@lo:400:kworker.0 Request processed in 30us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448605.823152:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448605.823181:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826404608:0@lo:400:kworker.0 00000100:00100000:1.0:1788448605.823198:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826404736:0@lo:8:kworker.0 00000100:00100000:1.0:1788448605.823221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.823238:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826404864:0@lo:8:kworker.0 00000100:00100000:1.0:1788448605.823256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448605.823291:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826404352:0@lo:400:kworker.0 00000100:00100000:1.0:1788448605.823327:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404736 00000100:00100000:1.0:1788448605.823331:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404736 00000100:00100000:1.0:1788448605.823345:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404864 00000100:00100000:1.0:1788448605.823348:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404864 00000100:00100000:1.0:1788448605.823358:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448605.823363:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826404736:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788448605.823387:0:18650:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:1.0:1788448605.823424:0:18650:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b804acd 00002000:00100000:1.0:1788448605.823438:0:18650:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9fc0834fe800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788448605.823442:0:18650:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788448605.823444:0:18650:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788448605.823605:0:18650:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788448605.823626:0:18650:0:(import.c:65:import_set_state_nolock()) ffff9fc0834fe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448605.823662:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826404736:12345-0@lo:8:kworker.0 Request processed in 299us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448605.823669:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448605.823681:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448605.823685:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826404864:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788448605.823696:0:18650:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1788448605.824587:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc19137c000 x1875323826404736/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448605.824600:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788448605.824607:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788448605.824616:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788448605.824621:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788448605.824624:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc185684000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788448605.824638:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788448605.824643:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826404736:0@lo:8:kworker.0 00000004:00080000:3.0:1788448605.824697:0:17887:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788448605.824715:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17887:1875323826405504:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.824757:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448605.824779:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18529e540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448605.824796:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448605.824801:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788448605.824931:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448605.824943:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826405376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.824971:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448605.825006:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405376 00000100:00100000:3.0:1788448605.825012:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405376 00000100:00100000:3.0:1788448605.825053:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448605.825061:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826405376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448605.825082:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788448605.825117:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1875323826405376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448605.825124:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788448605.825139:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448605.825172:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836eaa00 x1875323826405376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448605.825186:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826405376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.825241:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405504 00000100:00100000:3.0:1788448605.825245:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405504 00000100:00100000:3.0:1788448605.825324:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448605.825331:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875323826405504:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788448605.825981:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404480 00000100:00100000:2.0:1788448605.825987:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404480 00000100:00100000:2.0:1788448605.826019:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405248 00000100:00100000:2.0:1788448605.826023:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405248 00000100:00100000:2.0:1788448605.826044:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405120 00000100:00100000:2.0:1788448605.826046:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405120 00000100:00100000:2.0:1788448605.826058:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404992 00000100:00100000:2.0:1788448605.826061:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404992 00000100:00100000:2.0:1788448605.826073:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448605.826080:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826404480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448605.826133:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826404480:12345-0@lo:400:kworker.0 Request processed in 53us (3548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.826139:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448605.826152:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448605.826159:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826405248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448605.826185:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826405248:12345-0@lo:400:kworker.0 Request processed in 27us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.826190:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448605.826201:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448605.826207:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448605.826233:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826405120:12345-0@lo:400:kworker.0 Request processed in 27us (3522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.826239:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448605.826249:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448605.826255:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448605.826286:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826404992:12345-0@lo:400:kworker.0 Request processed in 31us (3226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.826292:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448605.826316:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826404224 00000100:00100000:2.0:1788448605.826327:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826404224 00000100:00100000:2.0:1788448605.826962:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788448605.826972:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3645:x1875323826404224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448605.827021:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3645:x1875323826404224:12345-0@lo:400:kworker.0 Request processed in 51us (3996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.827028:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000004:00080000:2.0:1788448605.827062:0:17886:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788448605.827137:0:17886:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 523172255129ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788448605.827143:0:17886:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:2.0:1788448605.827212:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448605.827217:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448605.827243:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826404224:0@lo:400:kworker.0 00010000:00080000:2.0:1788448605.827258:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc19137e300 x1875323826404992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448605.827269:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826404992:0@lo:400:kworker.0 00010000:00080000:0.0:1788448605.829075:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc19137ed80 x1875323826405120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448605.829092:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826405120:0@lo:400:kworker.0 00010000:00080000:0.0:1788448605.829105:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc19137fb80 x1875323826404480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448605.829114:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826404480:0@lo:400:kworker.0 00010000:00080000:0.0:1788448605.829125:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0835d2a00 x1875323826405248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448605.829132:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826405248:0@lo:400:kworker.0 00002000:00080000:2.0:1788448605.838250:0:19177:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:2.0:1788448605.838260:0:19177:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00010000:00080000:3.0:1788448605.838935:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836e8700 x1875323826405504/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448605.838951:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17887:1875323826405504:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788448605.838963:0:17887:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788448605.839001:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17887:1875323826405632:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.839040:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448605.839068:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18529e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448605.839212:0:18651:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1788448605.839220:0:18651:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788448605.839395:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875323826405504:12345-0@lo:7:osp-pre-0-1.0 Request processed in 13017us (13590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.839419:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448605.839477:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405632 00000100:00100000:2.0:1788448605.839483:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405632 00000004:00080000:2.0:1788448605.839757:0:17878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:2.0:1788448605.839786:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448605.839796:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875323826405632:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788448605.839824:0:19177:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788448605.839877:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17887:x1875323826405632:12345-0@lo:5:osp-pre-0-1.0 Request processed in 82us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448605.839916:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788448605.840178:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836e8700 x1875323826405632/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448621 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448605.840189:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17887:1875323826405632:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788448605.840199:0:17887:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788448605.840245:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17887:1875323826405760:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.840287:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448605.849835:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc18529e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448605.856132:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826404864:12345-0@lo:8:kworker.0 Request processed in 32440us (32869us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788448605.856145:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448605.857910:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405760 00000100:00100000:0.0:1788448605.857924:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405760 00000100:00100000:0.0:1788448605.858010:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448605.858036:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17887:x1875323826405760:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788448605.858108:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00080000:2.0:1788448605.858479:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448605.858486:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788448605.858490:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826404864:0@lo:8:kworker.0 00010000:00010000:0.0:1788448605.891034:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448605.919856:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788448605.919921:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788448605.920461:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17887:x1875323826405760:12345-0@lo:5:osp-pre-0-1.0 Request processed in 62437us (80179us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788448605.920472:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788448605.922130:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836e8700 x1875323826405760/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448605.922162:0:17887:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788448605.922169:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17887:1875323826405760:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788448605.922197:0:17887:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788448605.924662:0:17887:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1875323826405888:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788448605.924733:0:17887:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448605.924778:0:17887:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc199bf6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448605.925586:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826405888 00000100:00100000:3.0:1788448605.925596:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826405888 00000100:00100000:3.0:1788448605.925650:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448605.925677:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1875323826405888:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.925805:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17887:x1875323826405888:12345-0@lo:900:osp-pre-0-1.0 Request processed in 146us (1071us total) trans 0 rc 0/0 00010000:00080000:2.0:1788448605.925862:0:17887:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7cad80 x1875323826405888/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448621 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448605.925877:0:17887:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17887:1875323826405888:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788448605.926485:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788448606.910073:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448607.358564:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788448607.934331:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448608.959503:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448609.984632:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448610.494043:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448610.494063:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826406016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448610.494180:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.494250:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406016 00000100:00100000:1.0:1788448610.494272:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406016 00000100:00100000:1.0:1788448610.494318:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448610.494327:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826406016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448610.494357:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448610.494408:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826406016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448610.494415:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448610.494466:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083688700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826406016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448610.506612:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826406144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448610.506679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448610.506757:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406144 00000100:00100000:0.0:1788448610.506775:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406144 00000100:00100000:0.0:1788448610.506824:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448610.506834:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826406144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448610.506879:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788448610.514176:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826406144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7333us (7487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448610.514190:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448610.514396:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826406144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448610.942134:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448590/real 1788448590] req@ffff9fc0835d0700 x1875323826397696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448610 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448610.942159:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc0835d0700 x1875323826397696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448610 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448610.942169:0:3644:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448590/real 1788448590] req@ffff9fc0835d3480 x1875323826397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448610 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448610.942179:0:3644:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9fc0835d3480 x1875323826397824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448610 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448610.942195:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448610.942212:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448610.942215:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826397696:0@lo:8:kworker.0 00000100:00080000:1.0:1788448610.942220:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448610.942233:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448610.942236:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0835d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826397824:0@lo:8:kworker.0 00000100:00080000:3.0:1788448610.943137:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448610.943142:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788448610.943145:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448610.943151:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1788448610.943155:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788448610.943161:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9fc082765000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448610.943182:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e8a80 x1875323826406528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448610.943196:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448610.943198:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448610.943200:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448610.943203:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:3.0:1788448610.943205:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788448610.943209:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc187ba0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448610.943228:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0836e9180 x1875323826406656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448610.943253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448610.943256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448610.943258:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448610.943261:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1788448610.943263:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788448610.943267:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc190ac4000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:0.0:1788448610.943406:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826406272:0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.943485:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448610.943523:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826407040:0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.943554:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448610.943576:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448610.943581:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826406912:0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.943605:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448610.943759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b4897480 x1875323826407168/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448610.944035:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826407552:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.944104:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826406400:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944141:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.944156:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826407296:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944175:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.944193:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788448610.944199:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826406784:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.944236:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826407424:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944260:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.944403:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406272 00000100:00100000:1.0:1788448610.944410:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406272 00000100:00100000:1.0:1788448610.944560:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788448610.944570:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3648:x1875323826406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944613:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3648:x1875323826406272:12345-0@lo:400:kworker.0 Request processed in 44us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448610.944619:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788448610.944650:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407552 00000100:00100000:1.0:1788448610.944653:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407552 00000100:00100000:1.0:1788448610.944682:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407296 00000100:00100000:1.0:1788448610.944684:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407296 00000100:00100000:1.0:1788448610.944694:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406784 00000100:00100000:1.0:1788448610.944697:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406784 00000100:00100000:1.0:1788448610.944718:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407424 00000100:00100000:1.0:1788448610.944721:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407424 00000100:00100000:1.0:1788448610.944737:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448610.944743:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826407552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.944780:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826407552:12345-0@lo:400:kworker.0 Request processed in 37us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448610.944786:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448610.944798:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448610.944803:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826407296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.945570:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826407296:12345-0@lo:400:kworker.0 Request processed in 764us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448610.945577:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448610.945593:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448610.945602:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.945631:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826406784:12345-0@lo:400:kworker.0 Request processed in 32us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448610.945636:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448610.945646:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448610.945651:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826407424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.945674:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826407424:12345-0@lo:400:kworker.0 Request processed in 24us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448610.945680:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788448610.945724:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4895500 x1875323826407552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448610.945737:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826407552:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.945771:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826406528:0@lo:8:kworker.0 00000100:00100000:1.0:1788448610.945802:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.945847:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826406656:0@lo:8:kworker.0 00000100:00100000:1.0:1788448610.945869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.945902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826407168:0@lo:8:kworker.0 00000100:00100000:1.0:1788448610.945923:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448610.945948:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407040 00000100:00100000:3.0:1788448610.945949:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406528 00000100:00100000:3.0:1788448610.945952:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406528 00000100:00100000:1.0:1788448610.945952:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407040 00000100:00100000:3.0:1788448610.945972:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407168 00000100:00100000:1.0:1788448610.945972:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406656 00000100:00100000:3.0:1788448610.945975:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407168 00000100:00100000:1.0:1788448610.945975:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406656 00000100:00100000:1.0:1788448610.945983:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448610.945988:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826407040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.946046:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826406272:0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.946073:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406912 00000100:00100000:0.0:1788448610.946076:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406912 00000100:00100000:0.0:1788448610.946096:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826406400 00000100:00100000:0.0:1788448610.946098:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826406400 00000100:00100000:0.0:1788448610.946125:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448610.946132:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826406912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.946170:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826406912:12345-0@lo:400:kworker.0 Request processed in 39us (2563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448610.946176:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448610.946188:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448610.946194:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826406400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.946233:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08368b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826406400:12345-0@lo:400:kworker.0 Request processed in 39us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448610.946239:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788448610.947369:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826407040:12345-0@lo:400:kworker.0 Request processed in 1379us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448610.953983:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448610.953998:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875323826406528:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788448610.954035:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1788448610.954131:0:18651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b804ad4 00002000:00100000:3.0:1788448610.954148:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9fc1873a2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788448610.954152:0:18651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788448610.954155:0:18651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788448610.954225:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788448610.954263:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9fc0835ea000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448610.954346:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826406528:12345-0@lo:8:kworker.0 Request processed in 349us (8541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448610.954354:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448610.954399:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448610.954403:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875323826406656:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788448610.954416:0:18651:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788448610.959031:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448610.959045:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826407168:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788448610.959070:0:18652:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788448610.960215:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875323826407168:12345-0@lo:8:kworker.0 Request processed in 1168us (14285us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448610.960226:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448610.960298:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826406912:0@lo:400:kworker.0 00010000:00080000:0.0:1788448610.960313:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836ea680 x1875323826407040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448610.960322:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826407040:0@lo:400:kworker.0 00000100:00080000:2.0:1788448610.962390:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448610.962398:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448610.962401:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788448610.963017:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836ea300 x1875323826406784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448610.963033:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826406784:0@lo:400:kworker.0 00010000:00080000:0.0:1788448610.963047:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4896300 x1875323826407424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448610.963056:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826407424:0@lo:400:kworker.0 00000100:00100000:0.0:1788448610.963069:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826406400:0@lo:400:kworker.0 00010000:00080000:0.0:1788448610.963080:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1b4895c00 x1875323826407296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448610.963103:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826407296:0@lo:400:kworker.0 00000100:00100000:1.0:1788448610.968524:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788448610.968608:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0836e8a80 x1875323826406528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448635 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448610.968621:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788448610.968630:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788448610.968639:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788448610.968644:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788448610.968648:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc082765000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788448610.968675:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788448610.968682:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826406528:0@lo:8:kworker.0 00000100:00080000:1.0:1788448610.968697:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448610.968701:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788448610.968714:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826407168:0@lo:8:kworker.0 00000004:00080000:1.0:1788448610.968746:0:17169:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448610.968839:0:17169:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 528313957167ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448610.968846:0:17169:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788448610.969185:0:17170:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788448610.969206:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1875323826407808:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788448610.969265:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448610.969305:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448610.969323:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407808 00000100:00100000:2.0:1788448610.969328:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407808 00000100:00100000:2.0:1788448610.969383:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448610.969392:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17170:x1875323826407808:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1788448610.969584:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448610.971738:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826407680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448610.971800:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448610.971998:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407680 00000100:00100000:2.0:1788448610.972006:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407680 00000100:00100000:2.0:1788448610.972051:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448610.972060:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826407680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448610.972084:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448610.972136:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3648:x1875323826407680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448610.972143:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448610.972282:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7c9500 x1875323826407680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448610.972301:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826407680:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788448610.977195:0:18652:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788448610.977207:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788448610.977214:0:18652:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:2.0:1788448610.977293:0:17125:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788448610.981446:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875323826406656:12345-0@lo:8:kworker.0 Request processed in 27036us (35571us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788448610.981460:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788448610.981601:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448610.981609:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788448610.981612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826406656:0@lo:8:kworker.0 00000100:00100000:2.0:1788448611.011531:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448611.011552:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826407936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448611.011615:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448611.011658:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826407936 00000100:00100000:2.0:1788448611.011665:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826407936 00000100:00100000:2.0:1788448611.011704:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448611.011712:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826407936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448611.011732:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448611.011771:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826407936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448611.011777:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788448611.011813:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7c8700 x1875323826407936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448627 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448611.011830:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826407936:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788448611.016156:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.022567:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.022582:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.022600:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.022604:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.022612:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.022630:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.022640:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.022648:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.022663:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448611.023046:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448611.023054:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.023062:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448611.023066:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.023075:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.023092:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.023121:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804adb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.023142:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.023144:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.023146:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.023606:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.023618:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.023626:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.023630:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.023633:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.023643:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.023650:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.023656:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.023674:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788448611.024155:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.024162:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024171:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.024174:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.024178:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024188:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024195:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024201:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024224:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788448611.024445:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448611.024451:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024458:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.024462:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024469:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024490:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024497:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804ae2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024513:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.024516:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024523:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.024525:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024532:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024542:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024548:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a115c339/0xf45a9e4e6b804ae9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.024560:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.024562:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.024569:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448611.024955:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.024966:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024975:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.024978:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.024982:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.024992:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025000:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025007:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025023:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448611.025051:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448611.025057:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.025064:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448611.025068:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.025088:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.025101:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.025110:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b804af0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.025133:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.025135:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.025137:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448611.025397:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.025403:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025410:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.025413:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.025417:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025492:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025507:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025514:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.025535:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.025761:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.025766:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.025773:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fcc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.025776:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.025784:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.025795:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.025802:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804af7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.025816:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.025818:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.025820:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.027128:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448611.027286:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.027294:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.027306:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.027310:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.027316:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.027326:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.027335:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.027343:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.027392:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.027570:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.027577:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.027585:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.027589:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.027607:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.027619:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.027626:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c528d22/0xf45a9e4e6b804afe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.027640:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.027641:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.027643:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448611.029086:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.029097:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.029118:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.029122:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.029128:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.029139:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.029147:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.029154:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.029174:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448611.029442:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448611.029450:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.029458:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fde00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448611.029462:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.029480:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.029495:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.029502:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad116af6/0xf45a9e4e6b804b05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.029519:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.029521:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.029523:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.030521:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.030529:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.030539:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.030543:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.030547:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.030557:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.030565:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.030578:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.030604:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448611.030870:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448611.030876:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.030908:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448611.030912:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.030920:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.030936:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.030943:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ead6598/0xf45a9e4e6b804b0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.030959:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.030961:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.030962:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.031641:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.031648:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.031658:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.031661:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.031666:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.031676:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.031684:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.031692:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.031714:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448611.031848:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448611.031853:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.031861:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448611.031871:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.031911:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.031924:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.031931:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804b13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.031946:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.031948:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.031950:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.032874:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.032914:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.032932:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.032936:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.032941:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.032952:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.032960:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.032967:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.032982:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448611.033381:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448611.033387:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.033395:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448611.033398:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.033407:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.033419:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.033440:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804b1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.033457:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.033459:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.033461:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.033577:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.033583:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.033592:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.033595:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.033599:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.033608:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.033625:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.033632:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.033650:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788448611.034148:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.034155:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034163:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.034166:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.034170:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034180:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034188:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034195:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034288:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788448611.034800:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.034807:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034816:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.034832:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.034838:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034848:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034856:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.034862:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035865:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788448611.035874:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035895:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448611.035907:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035916:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035930:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035938:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000103690eb/0xf45a9e4e6b804b21 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035958:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448611.035962:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035968:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448611.035971:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035977:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035985:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.035991:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804b28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.036011:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448611.036014:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.036021:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448611.036023:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.036030:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.036040:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.036046:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.036048:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.036050:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.044232:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.045056:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788448611.045071:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804b2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.048418:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.048686:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.048697:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.048717:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.048721:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.048727:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.048740:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.048749:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.048756:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.048778:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788448611.051095:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.051108:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051123:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.051127:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.051133:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051145:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051168:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051175:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051198:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788448611.051212:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448611.051223:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051230:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.051235:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051244:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051260:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051267:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a9d668a/0xf45a9e4e6b804b36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051284:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.051294:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051300:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.051303:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051311:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051322:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051329:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c8068ef/0xf45a9e4e6b804b3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.051341:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.051343:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.051344:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448611.051595:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.058403:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.058416:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058433:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.058438:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.058444:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058478:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058489:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058497:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058515:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.058527:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.058532:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058540:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.058545:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058554:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058570:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058576:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804b44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.058600:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.058602:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.058604:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.059096:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.059103:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059112:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.059115:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.059120:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059129:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059136:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059143:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059160:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.059168:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.059172:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059190:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.059193:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059201:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059213:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059219:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000daca2270/0xf45a9e4e6b804b4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059233:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.059235:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.059236:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.059556:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.059562:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059571:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.059574:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.059578:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059588:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059602:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059609:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059623:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.059632:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.059635:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059641:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.059644:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059652:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059663:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059671:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064a5722a/0xf45a9e4e6b804b52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.059684:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.059692:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.059693:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.060044:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.060049:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060057:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.060060:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.060064:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060072:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060080:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060087:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060099:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.060106:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.060110:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060117:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152fa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.060120:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060139:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060150:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060157:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b7aca1/0xf45a9e4e6b804b59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060172:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.060174:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.060176:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448611.060649:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788448611.060655:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060664:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788448611.060667:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448611.060671:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060679:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060686:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060704:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.060726:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448611.061080:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448611.061086:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061093:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448611.061096:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061114:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061127:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061134:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f18f6e9/0xf45a9e4e6b804b60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061150:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.061152:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.061153:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448611.061296:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.061302:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061310:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.061313:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.061317:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061326:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061334:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061352:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061379:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788448611.061676:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.061681:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061689:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.061692:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.061696:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061705:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061712:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061719:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.061740:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788448611.061969:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448611.061975:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.061982:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448611.061986:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.061993:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062006:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062023:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007663537/0xf45a9e4e6b804b67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062039:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448611.062042:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062048:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448611.062050:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062057:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062067:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062074:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.062085:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.062086:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.062087:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448611.062228:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.062234:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.062305:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.062309:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.062314:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.062324:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.062333:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.062341:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.062400:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448611.070475:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448611.070489:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.070516:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448611.070521:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.070531:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.070552:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.070559:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083582ae9/0xf45a9e4e6b804b75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.070583:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.070585:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.070587:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.070646:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448611.071533:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448611.071544:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.071556:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788448611.071560:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448611.071566:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.071578:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.071587:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.071595:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.071635:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448611.072065:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448611.072072:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.072079:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448611.072083:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.072091:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.072110:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.072117:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054e87047/0xf45a9e4e6b804b7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448611.072133:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.072135:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448611.072136:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448611.072280:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448611.072287:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072296:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788448611.072299:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448611.072303:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072312:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072318:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072325:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072345:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448611.072608:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.072613:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.072622:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.072625:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.072632:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.072643:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.072649:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069329479/0xf45a9e4e6b804b83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.072662:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.072664:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.072665:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448611.072734:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448611.072739:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072747:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788448611.072756:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448611.072760:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072770:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072777:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072783:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448611.072945:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788448611.076096:0:18652:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448611.076109:0:18652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.076125:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788448611.076130:0:18652:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448611.076136:0:18652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.076148:0:18652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.076170:0:18652:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448611.076177:0:18652:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080525:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448611.080546:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080559:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ea00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.080564:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080574:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080594:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080602:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002e02b07e/0xf45a9e4e6b804b8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080623:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448611.080627:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080634:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:3.0:1788448611.080638:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080647:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080668:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448611.080676:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.080678:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448611.080681:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448611.082182:0:18652:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788448611.082194:0:18652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000224c6c45/0xf45a9e4e6b804b91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788448611.082303:0:18652:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:1.0:1788448611.082437:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17170:x1875323826407808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 113043us (113168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448611.082446:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448611.087390:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1875323826407808:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788448611.087408:0:17170:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1788448611.087453:0:17170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1875323826408064:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788448611.087505:0:17170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448611.087532:0:17170:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448611.087555:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408064 00000100:00100000:2.0:1788448611.087560:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408064 00000100:00100000:2.0:1788448611.087604:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448611.087612:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17170:x1875323826408064:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788448611.087645:0:19178:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:3.0:1788448611.092640:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448611.097271:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788448611.097314:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788448611.100179:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17170:x1875323826408064:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12558us (12664us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788448611.100191:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448611.107048:0:17170:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788448611.107064:0:17170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17170:1875323826408064:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788448611.107082:0:17170:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000040:00080000:0.0:1788448611.520705:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788448612.032917:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448612.115826:0:19464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448612.115829:0:19464:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788448612.115831:0:19464:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788448612.115982:0:19464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9fc1bb4c1000 00000020:01000004:3.0:1788448612.116005:0:19464:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788448612.116018:0:19464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788448612.116037:0:19464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9fc083f119b8) 00000020:00000080:3.0:1788448612.116054:0:19464:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788448612.217987:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788448612.223645:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788448612.224102:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788448612.224449:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788448612.224631:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788448612.224803:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788448612.225138:0:19464:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:2.0:1788448612.229755:0:19464:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788448612.230780:0:19464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788448612.230794:0:19464:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788448612.230806:0:19464:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45a9e4e6b804b9f 00000020:01000004:2.0:1788448612.230814:0:19464:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788448612.230846:0:19464:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.121@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788448612.230849:0:19464:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.121@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788448612.230854:0:19464:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788448612.230905:0:19464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788448612.230909:0:19464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.121@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788448612.250616:0:19464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.121@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788448612.250667:0:19464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.121@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788448612.250671:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788448612.250673:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448612.250674:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448612.250675:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448612.250677:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448612.250677:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448612.250679:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448612.250681:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448612.250682:0:19464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448612.250686:0:19464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788448612.250688:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448612.250689:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448612.250690:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448612.250691:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448612.250692:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448612.250699:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448612.250700:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448612.250701:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448612.250701:0:19464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788448612.250725:0:19464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788448612.250744:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408192:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448612.250809:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.250862:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448612.251026:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408192 00000100:00100000:2.0:1788448612.251035:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408192 00000100:00100000:2.0:1788448612.251084:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788448612.251093:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:19464:x1875323826408192:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788448612.251133:0:17139:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788448612.251136:0:17139:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788448612.251140:0:17139:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788448612.252064:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:19464:x1875323826408192:12345-0@lo:253:mount.lustre.0 Request processed in 970us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448612.252074:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788448612.252163:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408192:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448612.252173:0:19464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788448612.252175:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448612.252176:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448612.252177:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448612.252178:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448612.252179:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448612.252180:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448612.252181:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448612.252183:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448612.252184:0:19464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788448612.252201:0:19464:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9fc1bb4c1000 from lustre-OST0001 10000000:01000000:0.0:1788448612.252236:0:19464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788448612.252248:0:19464:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788448612.252256:0:19464:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9fc1bb53cd28 local copy 00010000:00010000:0.0:1788448612.252267:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.252346:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448612.252388:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.252461:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.252642:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408320 00000100:00100000:1.0:1788448612.252648:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408320 00000100:00100000:1.0:1788448612.252718:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788448612.252727:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:19464:x1875323826408320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448612.252797:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:19464:x1875323826408320:12345-0@lo:501:mount.lustre.0 Request processed in 71us (409us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448612.252804:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788448612.252866:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408320:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788448612.252877:0:19464:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.121@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788448612.252925:0:19464:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.121@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788448612.252940:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.252948:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e400/0xf45a9e4e6b8047f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b8047fc expref: -99 pid: 17124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448612.252970:0:19464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9fc1bb4c1000 10000000:01000000:0.0:1788448612.252975:0:19464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788448612.252979:0:19464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788448612.252982:0:19464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448612.252986:0:19464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788448612.252988:0:19464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788448612.253007:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.253015:0:19464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.253023:0:19464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.253035:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448612.253062:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.264153:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448612.264389:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408448 00000100:00100000:2.0:1788448612.264398:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408448 00000100:00100000:2.0:1788448612.266054:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448612.266067:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:19464:x1875323826408448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448612.266083:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448612.266101:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330a00/0xf45a9e4e6b804bad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804ba6 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.266128:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330a00/0xf45a9e4e6b804bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804ba6 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.266158:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0330a00/0xf45a9e4e6b804bad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804ba6 expref: 22 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.266166:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330a00, rc 0) 00000100:00100000:2.0:1788448612.266417:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408448:12345-0@lo:101:mount.lustre.0 Request processed in 352us (13353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448612.266425:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788448612.266533:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448612.266553:0:19464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.266563:0:19464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448612.268397:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788448612.269562:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448612.284146:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788448612.284203:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788448612.284221:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788448612.285080:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788448612.285134:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788448612.285164:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788448612.285200:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788448612.285206:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788448612.285748:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408576:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448612.285812:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.285920:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196977180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448612.290320:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408576 00000100:00100000:2.0:1788448612.290333:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408576 00000100:00100000:3.0:1788448612.290506:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788448612.290518:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408576:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448612.290711:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408576:12345-0@lo:501:mount.lustre.0 Request processed in 194us (4898us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.290720:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448612.290824:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408576:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448612.290872:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408704:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448612.290958:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.290990:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb435480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448612.291192:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408704 00000100:00100000:3.0:1788448612.291196:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408704 00000100:00100000:3.0:1788448612.291222:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788448612.291229:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448612.292267:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408704:12345-0@lo:503:mount.lustre.0 Request processed in 1034us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.292275:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788448612.292454:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448612.292855:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448612.292980:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448612.293021:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.293042:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.293131:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408832 00000100:00100000:1.0:1788448612.293136:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408832 00000100:00100000:1.0:1788448612.293176:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788448612.293185:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.293619:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408832:12345-0@lo:502:mount.lustre.0 Request processed in 434us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.293627:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788448612.293707:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448612.293968:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788448612.293996:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788448612.294012:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788448612.294027:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788448612.294042:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788448612.294056:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788448612.294071:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788448612.294086:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788448612.294101:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788448612.294126:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448612.294164:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.294189:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.294334:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826408960 00000100:00100000:1.0:1788448612.294340:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826408960 00000100:00100000:1.0:1788448612.294385:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788448612.294393:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.294474:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826408960:12345-0@lo:502:mount.lustre.0 Request processed in 82us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.294482:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448612.294770:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826408960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448612.294813:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788448612.294822:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788448612.309789:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448612.309800:0:19468:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788448612.309807:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448612.309809:0:19468:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788448612.309821:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448612.309836:0:19468:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9fc191388000) 00000020:00000080:2.0:1788448612.309861:0:19468:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788448612.309867:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788448612.309968:0:19468:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bb4c1000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788448612.309976:0:19468:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448612.309982:0:19468:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf45a9e4e6b804bbb 00010000:00010000:1.0:1788448612.320814:0:19468:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788448612.322557:0:19468:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788448612.325206:0:19468:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788448612.334678:0:19468:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788448612.334692:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.334698:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.334701:0:19468:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788448612.334705:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448612.334715:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.334716:0:19468:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448612.334720:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448612.334722:0:19468:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448612.334724:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.334726:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.334728:0:19468:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788448612.334730:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448612.334732:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.334734:0:19468:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448612.334737:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788448612.334767:0:19468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.334771:0:19468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.334772:0:19468:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448612.334775:0:19468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788448612.343797:0:19464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788448612.344052:0:19464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788448612.344106:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.344118:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e000/0xf45a9e4e6b804ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bad expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448612.345509:0:19464:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bb4c1000 from 1 10000000:01000000:0.0:1788448612.345531:0:19464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448612.345567:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.345576:0:19464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.345586:0:19464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.345621:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409088:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448612.345682:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.345728:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448612.345789:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409088 00000100:00100000:3.0:1788448612.345796:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409088 00000100:00100000:3.0:1788448612.345857:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788448612.345867:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:19464:x1875323826409088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448612.345903:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448612.345914:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804bc2 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448612.345937:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448612.345947:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448612.345956:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152fa00, rc 0) 00000100:00100000:3.0:1788448612.345992:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409088:12345-0@lo:101:mount.lustre.0 Request processed in 126us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.346005:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448612.346176:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409088:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448612.346189:0:19464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.346197:0:19464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448612.347784:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788448612.348526:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448612.348696:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788448612.348721:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788448612.348738:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788448612.348743:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788448612.348813:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448612.349541:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.349632:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.355850:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409216 00000100:00100000:1.0:1788448612.355865:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409216 00000100:00100000:1.0:1788448612.355934:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788448612.355943:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409216:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448612.356110:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409216:12345-0@lo:501:mount.lustre.0 Request processed in 167us (6569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.356118:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788448612.356278:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448612.356325:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448612.356391:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.356429:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448612.356482:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409344 00000100:00100000:3.0:1788448612.356487:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409344 00000100:00100000:3.0:1788448612.356521:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788448612.356528:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409344:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448612.356627:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409344:12345-0@lo:503:mount.lustre.0 Request processed in 99us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.356634:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788448612.358433:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409344:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448612.358918:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448612.359003:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448612.359061:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.359095:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d199c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448612.359214:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409472 00000100:00100000:3.0:1788448612.359221:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409472 00000100:00100000:3.0:1788448612.359265:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788448612.359273:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409472:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448612.359386:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409472:12345-0@lo:502:mount.lustre.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.359393:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788448612.359439:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409472:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448612.359658:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788448612.359682:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788448612.359709:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788448612.359723:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788448612.359735:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788448612.359746:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788448612.359757:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788448612.359769:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788448612.359779:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788448612.359791:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788448612.359804:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788448612.359832:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448612.359868:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448612.359920:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409600 00000100:00100000:3.0:1788448612.359924:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409600 00000100:00100000:3.0:1788448612.359942:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788448612.359948:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409600:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448612.360009:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409600:12345-0@lo:502:mount.lustre.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.360016:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788448612.360049:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1863d3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448612.360063:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448612.360100:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788448612.360107:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788448612.361256:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448612.361266:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361269:0:19472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788448612.361275:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1bb4c1000 00000020:00000080:1.0:1788448612.361278:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448612.361287:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.361290:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361291:0:19472:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788448612.361294:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448612.361296:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361306:0:19472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788448612.361309:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9fc1bb4c1000 00000020:00000080:1.0:1788448612.361312:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448612.361377:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.361381:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361382:0:19472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788448612.361384:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448612.361387:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361388:0:19472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788448612.361391:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1bb4c1000 00000020:00000080:1.0:1788448612.361393:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448612.361411:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.361414:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361415:0:19472:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788448612.361418:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448612.361420:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361421:0:19472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788448612.361424:0:19472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9fc1bb4c1000 00000020:00000080:1.0:1788448612.361426:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448612.361448:0:19472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448612.361451:0:19472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448612.361452:0:19472:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788448612.361455:0:19472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788448612.361748:0:19464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788448612.361775:0:19464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448612.361796:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.361806:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448612.361870:0:19464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788448612.361872:0:19464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9fc1bb4c1000 10000000:01000000:2.0:1788448612.361875:0:19464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9fc1bb4c1000 10000000:01000000:2.0:1788448612.361895:0:19464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448612.361901:0:19464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9fc1bb4c1000 from 1 10000000:01000000:2.0:1788448612.361903:0:19464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448612.361932:0:19464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.361949:0:19464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.361959:0:19464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448612.361978:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409728:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448612.362026:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.362055:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448612.362376:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409728 00000100:00100000:3.0:1788448612.362384:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409728 00000100:00100000:3.0:1788448612.362427:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788448612.362438:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826409728:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448612.362448:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448612.362459:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b804bd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804bd0 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448612.362491:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b804bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804bd0 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448612.362501:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc18152ec00/0xf45a9e4e6b804bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804bd0 expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448612.362509:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc18152ec00, rc 0) 00000100:00100000:3.0:1788448612.362558:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826409728:12345-0@lo:101:mount.lustre.0 Request processed in 122us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.362564:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788448612.368505:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409728:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448612.368533:0:19464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.368545:0:19464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448612.378627:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1788448612.378926:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448612.379130:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788448612.379156:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788448612.379172:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788448612.379185:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788448612.379198:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788448612.379212:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788448612.379226:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788448612.379240:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788448612.379267:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788448612.379282:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788448612.379309:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788448612.379325:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788448612.379340:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788448612.379355:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788448612.379381:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788448612.379406:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788448612.379420:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788448612.379431:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788448612.379442:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788448612.379452:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788448612.379463:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788448612.379475:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788448612.379490:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788448612.379504:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788448612.379518:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788448612.379532:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788448612.379547:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788448612.379561:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788448612.379575:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788448612.379588:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788448612.379602:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788448612.379630:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788448612.379646:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788448612.379659:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788448612.379672:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788448612.379684:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788448612.379698:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788448612.379711:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788448612.379725:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788448612.379740:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788448612.379753:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788448612.379767:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788448612.379781:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788448612.379808:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788448612.379823:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788448612.379837:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788448612.379857:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788448612.379863:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1788448612.379962:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448612.380020:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.380060:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d19b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.380200:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409856 00000100:00100000:1.0:1788448612.380208:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409856 00000100:00100000:1.0:1788448612.380264:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788448612.380274:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826409856:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448612.380390:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826409856:12345-0@lo:501:mount.lustre.0 Request processed in 117us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.380398:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788448612.380443:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448612.380485:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448612.380522:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.380544:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826409984 00000100:00100000:1.0:1788448612.380549:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826409984 00000100:00100000:1.0:1788448612.380571:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788448612.380578:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826409984:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448612.380646:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826409984:12345-0@lo:503:mount.lustre.0 Request processed in 68us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.380653:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788448612.380684:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.380697:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826409984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788448612.381025:0:19464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448612.381078:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826410112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.381112:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.381133:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410112 00000100:00100000:1.0:1788448612.381137:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410112 00000100:00100000:1.0:1788448612.381158:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788448612.381165:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826410112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.381238:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826410112:12345-0@lo:502:mount.lustre.0 Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.381245:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788448612.381275:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.381287:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826410112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448612.381443:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788448612.381465:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788448612.381502:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788448612.381516:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788448612.381543:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788448612.381560:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788448612.381571:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788448612.381582:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788448612.381593:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788448612.381604:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788448612.381616:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788448612.381627:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788448612.381637:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788448612.381649:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788448612.381660:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788448612.381671:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788448612.381682:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788448612.381695:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788448612.381706:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788448612.381717:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788448612.381740:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788448612.381756:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788448612.381770:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788448612.381783:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788448612.381795:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:1.0:1788448612.381808:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:1.0:1788448612.381822:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:1.0:1788448612.381833:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:1.0:1788448612.381842:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:1.0:1788448612.381852:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:1.0:1788448612.381861:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:1.0:1788448612.381872:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:1.0:1788448612.381904:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:1.0:1788448612.381917:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:1.0:1788448612.381927:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:1.0:1788448612.381952:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:1.0:1788448612.381978:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:1.0:1788448612.381993:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:1.0:1788448612.382004:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:1.0:1788448612.382017:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:1.0:1788448612.382029:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:1.0:1788448612.382040:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:1.0:1788448612.382051:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:1.0:1788448612.382062:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:1.0:1788448612.382074:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:1.0:1788448612.382086:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:1.0:1788448612.382098:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:1.0:1788448612.382111:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:1.0:1788448612.382142:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826410240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.382179:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.382205:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410240 00000100:00100000:1.0:1788448612.382210:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410240 00000100:00100000:1.0:1788448612.382235:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448612.382242:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826410240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.382313:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826410240:12345-0@lo:502:mount.lustre.0 Request processed in 70us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.382320:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448612.382352:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.382382:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826410240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448612.382498:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:1.0:1788448612.382519:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788448612.382539:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826410368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.382570:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.382595:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410368 00000100:00100000:1.0:1788448612.382599:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410368 00000100:00100000:1.0:1788448612.382626:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788448612.382632:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826410368:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448612.382689:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826410368:12345-0@lo:502:mount.lustre.0 Request processed in 56us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.382694:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788448612.382722:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b037bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.382735:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826410368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448612.382767:0:19464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:1.0:1788448612.382773:0:19464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788448612.409590:0:19475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788448612.409621:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9fc19138cd28) 00000020:00000080:2.0:1788448612.409646:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1788448612.409740:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bb4c1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788448612.409744:0:19475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bb4c1000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788448612.409746:0:19475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bb4c1000 3 00010000:00080000:2.0:1788448612.409776:0:19475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc187bf5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.121@tcp at head 00010000:00010000:2.0:1788448612.420554:0:19475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1788448612.423792:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788448612.423853:0:19475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788448612.423866:0:19475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf45a9e4e6b804be5 00000100:00080000:2.0:1788448612.423876:0:19475:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448612.423897:0:19475:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9fc187bf5800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448612.423932:0:19475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf7caa00 x1875323826410496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448612.423969:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826410496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448612.424030:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788448612.424087:0:19475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788448612.424160:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448612.424164:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788448612.424176:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448612.424182:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 528 00000100:00080000:2.0:1788448612.424185:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788448612.424189:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc187ba0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448612.424203:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1bf7cad80 x1875323826410880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448612.424233:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448612.424235:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788448612.424237:0:36:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448612.424248:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:2.0:1788448612.424250:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788448612.424254:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc190ac4000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:2.0:1788448612.424279:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc083e20a80 x1875323826411392/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448612.424316:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826410624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.424346:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.424378:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826411264:0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.424401:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.424420:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448612.424426:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826411136:0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.424447:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.424462:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826411776:0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.425948:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.426001:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411264 00000100:00100000:2.0:1788448612.426009:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411264 00000100:00100000:2.0:1788448612.426085:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448612.426106:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826411264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.426157:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826411264:12345-0@lo:400:kworker.0 Request processed in 64us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448612.426164:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448612.426187:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410624 00000100:00100000:2.0:1788448612.426192:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410624 00000100:00100000:2.0:1788448612.426211:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411136 00000100:00100000:2.0:1788448612.426215:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411136 00000100:00100000:2.0:1788448612.426230:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448612.426236:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826410624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.426279:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826410624:12345-0@lo:400:kworker.0 Request processed in 43us (1931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448612.426285:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448612.426297:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448612.426305:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826411136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.426332:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826411136:12345-0@lo:400:kworker.0 Request processed in 30us (1886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448612.426338:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788448612.426353:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448612.426378:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826410880:0@lo:8:kworker.0 00000100:00100000:2.0:1788448612.426404:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.426420:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826411392:0@lo:8:kworker.0 00000100:00100000:2.0:1788448612.426437:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.426465:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410880 00000100:00100000:2.0:1788448612.426468:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410880 00000100:00100000:2.0:1788448612.426484:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411392 00000100:00100000:2.0:1788448612.426492:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411392 00000100:00100000:2.0:1788448612.426507:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448612.426511:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826410880:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788448612.426558:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826410880:12345-0@lo:8:kworker.0 Request processed in 45us (152us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788448612.426564:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448612.426574:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448612.426578:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826411392:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788448612.429137:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410496 00000100:00100000:1.0:1788448612.429151:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410496 00000100:00100000:1.0:1788448612.429194:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411776 00000100:00100000:1.0:1788448612.429197:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411776 00000100:00100000:1.0:1788448612.429436:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448612.429447:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826411776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448612.430571:0:17146:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448612.430582:0:17146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788448612.430844:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448612.430852:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875323826410496:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788448612.430877:0:17146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1788448612.430944:0:17146:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf45a9e4e6b804bec 00000100:00100000:1.0:1788448612.433991:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875323826411776:12345-0@lo:400:kworker.0 Request processed in 4539us (8039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.434006:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448612.434056:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.434095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.434133:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826411520:0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.434155:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.434177:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788448612.434183:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826411008:0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.434520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.434548:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826411648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.434573:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.434601:0:17147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448612.434610:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411520 00000100:00100000:1.0:1788448612.434617:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411520 00000100:00100000:1.0:1788448612.434646:0:17147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448612.434651:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411008 00000100:00100000:1.0:1788448612.434654:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411008 00000100:00100000:1.0:1788448612.434664:0:17147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448612.434668:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411648 00000100:00100000:1.0:1788448612.434670:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411648 00000100:00100000:1.0:1788448612.434685:0:17147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448612.434692:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448612.434699:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826411520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.434943:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826411520:12345-0@lo:400:kworker.0 Request processed in 50us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.434952:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448612.434965:0:17147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448612.434971:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448612.434977:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826411008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.435007:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826411008:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.435013:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448612.435022:0:17147:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448612.435028:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448612.435034:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826411648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.435059:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826411648:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.435064:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448612.435089:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826410752 00000100:00100000:1.0:1788448612.435093:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826410752 00000100:00100000:2.0:1788448612.435355:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875323826411392:12345-0@lo:8:kworker.0 Request processed in 8773us (8914us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788448612.435373:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448612.435425:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448612.435433:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448612.435437:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788448612.435440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826410880:0@lo:8:kworker.0 00000100:00100000:2.0:1788448612.435451:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448612.435455:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448612.435457:0:3644:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788448612.435460:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826411392:0@lo:8:kworker.0 00000100:00100000:1.0:1788448612.435472:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448612.435478:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826410752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.435500:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826411136:0@lo:400:kworker.0 00010000:00080000:2.0:1788448612.435513:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e21f80 x1875323826411776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448612.435522:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826410752:12345-0@lo:400:kworker.0 Request processed in 44us (1426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448612.435524:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875323826411776:0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.435529:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448612.435535:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826410624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448612.435546:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826411264:0@lo:400:kworker.0 00010000:00080000:1.0:1788448612.435553:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7cbb80 x1875323826411008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448612.435562:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826411008:0@lo:400:kworker.0 00010000:00080000:1.0:1788448612.435571:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e22300 x1875323826411648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448612.435579:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826411648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448612.435588:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826410752:0@lo:400:kworker.0 00010000:00080000:1.0:1788448612.435597:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc083e21880 x1875323826411520/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448628 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448612.435605:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826411520:0@lo:400:kworker.0 00000100:00080000:1.0:1788448612.435623:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448612.435627:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448612.435629:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:1.0:1788448612.437346:0:19475:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788448612.437362:0:19475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9fc1b5d599b8) 00000020:00000080:1.0:1788448612.437396:0:19475:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788448612.437469:0:19475:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9fc1bb4c1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788448612.437473:0:19475:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9fc1bb4c1000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788448612.437480:0:19475:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9fc1bb4c1000 3 00010000:00080000:1.0:1788448612.437508:0:19475:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9fc083f25000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.121@tcp at head 00000004:00100000:3.0:1788448612.438810:0:17146:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788448612.438974:0:17146:0:(import.c:65:import_set_state_nolock()) ffff9fc083fa1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448612.440944:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875323826410496:12345-0@lo:38:llog_process_th.0 Request processed in 10084us (16905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448612.440958:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788448612.442722:0:19475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788448612.442930:0:19475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788448612.442974:0:19475:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788448612.442985:0:19475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xf45a9e4e6b804bfa 00000100:00080000:1.0:1788448612.442994:0:19475:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448612.442999:0:19475:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9fc083f25000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:1.0:1788448612.443031:0:19475:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc0834f7100 x1875323826411904/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448612.443047:0:19475:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1788448612.452078:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc1bf7caa00 x1875323826410496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448612.452094:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448612.452105:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788448612.452114:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448612.452120:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448612.452123:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187bf5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448612.452130:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875323826410496:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448612.452160:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826411904:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448612.452374:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.452470:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826411904 00000100:00100000:0.0:1788448612.452483:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826411904 00000100:00100000:0.0:1788448612.452516:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448612.452523:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875323826411904:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788448612.452549:0:17147:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:0.0:1788448612.452596:0:17147:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xf45a9e4e6b804c01 00000004:00100000:0.0:1788448612.452624:0:17147:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788448612.452653:0:17147:0:(import.c:65:import_set_state_nolock()) ffff9fc1b738b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448612.452707:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875323826411904:12345-0@lo:38:llog_process_th.0 Request processed in 183us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448612.452714:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788448612.453080:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9fc0834f7100 x1875323826411904/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448622 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448612.453089:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448612.453094:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788448612.453100:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448612.453103:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788448612.453105:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc083f25000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448612.453110:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875323826411904:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788448612.455591:0:19475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:2.0:1788448612.455711:0:19464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788448612.455742:0:19464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448612.455755:0:19464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448612.455766:0:19464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0331000/0xf45a9e4e6b804bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804bd7 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788448612.455822:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788448612.455824:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448612.455826:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448612.455827:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448612.455829:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448612.455830:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448612.455832:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448612.455833:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448612.455835:0:19464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448612.455838:0:19464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788448612.455841:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448612.455842:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788448612.455843:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448612.455844:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448612.455845:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448612.455846:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448612.455847:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448612.455848:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448612.455849:0:19464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448612.455871:0:19464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788448612.455923:0:19464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826412032:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448612.456345:0:19464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448612.456387:0:19464:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc199bf6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448612.456607:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412032 00000100:00100000:1.0:1788448612.456614:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412032 00000100:00100000:1.0:1788448612.456652:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788448612.456661:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:19464:x1875323826412032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788448612.456686:0:17138:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788448612.456698:0:17138:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448612.477018:0:17138:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448612.477032:0:17138:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788448612.477090:0:17161:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788448612.477095:0:17161:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788448612.477116:0:17161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477135:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477143:0:17161:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477150:0:17161:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477186:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 24 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477200:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 24 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.477223:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826412160:0@lo:104: 00000100:00100000:0.0:1788448612.477291:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448612.477334:0:17161:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477343:0:17161:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.477351:0:17161:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826412288:0@lo:104: 00000100:00100000:0.0:1788448612.477383:0:17161:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.477400:0:17161:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08255da80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448612.477424:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412160 00000100:00100000:0.0:1788448612.477430:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412160 00000100:00100000:0.0:1788448612.477484:0:17129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412288 00000100:00100000:0.0:1788448612.477487:0:17129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412288 00000100:00100000:0.0:1788448612.477502:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448612.477510:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:17161:x1875323826412160:12345-0@lo:104: 00010000:00010000:0.0:1788448612.477521:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477567:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448612.477572:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:17161:x1875323826412160:12345-0@lo:104: Request processed in 63us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448612.477579:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448612.477594:0:17129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448612.477600:0:17129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826412288:12345-0@lo:104: 00010000:00010000:0.0:1788448612.477607:0:17129:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477648:0:17129:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788448612.477654:0:17129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:17161:x1875323826412288:12345-0@lo:104: Request processed in 54us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448612.477659:0:17129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788448612.477679:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448612.477684:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477691:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f800 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448612.477694:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477702:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448612.477709:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448612.477715:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448612.477745:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477751:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448612.477768:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477775:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc182c1f800/0xf45a9e4e6b804abf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804ac6 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477797:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448612.477800:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477805:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1a0330c00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448612.477808:0:17134:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477813:0:17134:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448612.477819:0:17134:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448612.477823:0:17134:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448612.477835:0:17134:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477841:0:17134:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448612.477853:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477860:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804ab8 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.477872:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448612.477874:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448612.477875:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448612.477900:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448612.477916:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826412416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448612.477945:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448612.477979:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412416 00000100:00100000:0.0:1788448612.477983:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412416 00010000:00010000:0.0:1788448612.477999:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 25 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.478019:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448612.478025:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943bfcb5-816e-4cdd-a66b-4e69884ef502+25:3646:x1875323826412416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448612.478033:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448612.478038:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 25 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.478047:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 25 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448612.478061:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448612.478088:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:943bfcb5-816e-4cdd-a66b-4e69884ef502+25:3646:x1875323826412416:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448612.478094:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448612.478126:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826412416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448612.478155:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fc800/0xf45a9e4e6b804ac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b804abf expref: 24 pid: 17140 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.478164:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826412160:0@lo:104: 00000100:00100000:0.0:1788448612.478171:0:17161:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17161:1875323826412288:0@lo:104: 00010000:00010000:0.0:1788448612.478183:0:17161:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448612.478928:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826412544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448612.478962:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448612.479007:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412544 00000100:00100000:1.0:1788448612.479012:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412544 00010000:00010000:1.0:1788448612.479029:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448612.479051:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448612.479057:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826412544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448612.479065:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448612.479069:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.479084:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.479095:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fdc00/0xf45a9e4e6b804ab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b804ab1 expref: 24 pid: 17138 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448612.480069:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:19464:x1875323826412032:12345-0@lo:253:mount.lustre.0 Request processed in 23405us (23721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448612.480079:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1788448612.480133:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480143:0:17131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448612.480157:0:17131:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004403396s 00010000:00010000:1.0:1788448612.480161:0:17131:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480167:0:17131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480174:0:17131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480180:0:17131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480186:0:17131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351ea00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448612.480189:0:17131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480197:0:17131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480220:0:17131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480230:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448612.480273:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3647:x1875323826412544:12345-0@lo:103:ldlm_bl.0 Request processed in 1214us (1309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448612.480280:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448612.480313:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826412544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448612.480336:0:17161:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480343:0:17161:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448612.480348:0:17161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351ea00/0xf45a9e4e6b804c08 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17161 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448612.480717:0:19464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:943bfcb5-816e-4cdd-a66b-4e69884ef502:19464:1875323826412032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788448612.480729:0:19464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788448612.480732:0:19464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788448612.480733:0:19464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448612.480735:0:19464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448612.480736:0:19464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448612.480737:0:19464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448612.480738:0:19464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448612.480740:0:19464:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448612.480742:0:19464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448612.480744:0:19464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788448612.480755:0:19464:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788448612.501995:0:19464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788448612.519572:0:19464:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788448612.519582:0:19464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788448612.519635:0:19464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788448612.519683:0:19464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.121@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788448612.519704:0:19464:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788448612.519734:0:19464:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788448612.532150:0:19464:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448612.532619:0:19464:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788448613.054213:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448613.566975:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788448613.566983:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc187ba7000 from 10 10000000:01000000:1.0:1788448613.566989:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448613.567039:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448613.567050:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448613.567060:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448613.567086:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826412672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448613.567163:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448613.567204:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448613.572135:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412672 00000100:00100000:2.0:1788448613.572150:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412672 00000100:00100000:2.0:1788448613.572234:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788448613.572257:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826412672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448613.572273:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448613.572292:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b804c16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804c0f expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.572319:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b804c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804c0f expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.572339:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0330e00/0xf45a9e4e6b804c16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804c0f expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.572348:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330e00, rc 0) 00000100:00100000:2.0:1788448613.572959:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826412672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 704us (5794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448613.572967:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788448613.573118:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826412672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448613.573137:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448613.573159:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448613.573220:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826412800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788448613.573810:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448613.574116:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448613.574413:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412800 00000100:00100000:2.0:1788448613.574421:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412800 00000100:00100000:2.0:1788448613.574494:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788448613.574504:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826412800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788448613.574523:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448613.574540:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448613.574543:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788448613.574637:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826412800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 135us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448613.574644:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788448613.574726:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826412800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788448613.574788:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448613.574797:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.574807:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc0824fc000/0xf45a9e4e6b804c0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c16 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448613.575011:0:17142:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448613.575020:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9fc083f6b800 from 10 10000000:01000000:2.0:1788448613.575023:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448613.575049:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575057:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575066:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448613.575083:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826412928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448613.575112:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448613.575132:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448613.575144:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826412928 00000100:00100000:2.0:1788448613.575147:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826412928 00000100:00100000:2.0:1788448613.575169:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788448613.575175:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826412928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448613.575183:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448613.575279:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0330800/0xf45a9e4e6b804c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804c1d expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575300:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0330800/0xf45a9e4e6b804c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804c1d expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575309:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0330800/0xf45a9e4e6b804c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804c1d expref: 24 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575318:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330800, rc 0) 00000100:00100000:2.0:1788448613.575351:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826412928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448613.575378:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788448613.575411:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826412928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448613.575421:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575429:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448613.575466:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826413056:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788448613.575506:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448613.575518:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1bb4359c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448613.575674:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413056 00000100:00100000:2.0:1788448613.575679:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413056 00000100:00100000:2.0:1788448613.575703:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788448613.575710:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826413056:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788448613.575721:0:17138:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448613.575732:0:17138:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448613.575734:0:17138:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788448613.575792:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826413056:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 82us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448613.575806:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788448613.575834:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826413056:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788448613.575874:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448613.575900:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448613.575919:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330200/0xf45a9e4e6b804c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804c24 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788448613.666851:0:19532:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788448613.672646:0:19532:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788448614.079475:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448615.107662:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448615.617326:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448615.617360:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826413312:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448615.617361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826413184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448615.622378:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448615.623533:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413312 00000100:00100000:0.0:1788448615.623549:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413312 00000100:00100000:0.0:1788448615.623629:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448615.623642:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826413312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788448615.623695:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448615.623794:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826413312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 155us (1428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448615.623803:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448615.626810:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448615.626936:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413184 00000100:00100000:2.0:1788448615.626947:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413184 00000100:00100000:2.0:1788448615.627011:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448615.627022:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826413184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788448615.627073:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788448615.627135:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826413184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448615.627143:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448615.627223:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826413184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448615.627567:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826413312:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448616.126356:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826413440:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448616.126429:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448616.126491:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413440 00000100:00100000:0.0:1788448616.126499:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413440 00000100:00100000:0.0:1788448616.126549:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448616.126559:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826413440:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788448616.126599:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788448616.126599:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788448616.126641:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826413440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448616.126649:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448616.127976:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826413568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448616.128027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448616.128154:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448616.129378:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826413440:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788448616.129716:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413568 00000100:00100000:1.0:1788448616.129724:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413568 00000100:00100000:1.0:1788448616.129913:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448616.129924:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826413568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448616.129944:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788448616.130166:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826413568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448616.130174:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448616.130213:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826413568:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788448616.130275:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448617.150128:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448617.599209:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788448617.662158:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448617.662165:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448617.662168:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448617.662180:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9fc187ba0800 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448617.662201:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b4897800 x1875323826414080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448617.662234:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448617.662237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448617.662239:0:37:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448617.662244:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9fc190ac4000 using connection 192.168.206.121@tcp/0@lo 00000100:00100000:3.0:1788448617.662254:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9fc1b4894700 x1875323826414592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448617.662303:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826413824:0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662435:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826414464:0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662479:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826415104:0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662533:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788448617.662539:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826413952:0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662561:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662579:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826414720:0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662619:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826415232:0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662641:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662672:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826414080:0@lo:8:kworker.0 00000100:00100000:3.0:1788448617.662694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662709:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826414592:0@lo:8:kworker.0 00000100:00100000:3.0:1788448617.662729:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.662757:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413824 00000100:00100000:3.0:1788448617.662764:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413824 00000100:00100000:3.0:1788448617.662810:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448617.662820:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826413824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.662873:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826413824:12345-0@lo:400:kworker.0 Request processed in 54us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.662907:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448617.662930:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414464 00000100:00100000:3.0:1788448617.662934:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414464 00000100:00100000:3.0:1788448617.662968:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413952 00000100:00100000:3.0:1788448617.662971:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413952 00000100:00100000:3.0:1788448617.662981:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414080 00000100:00100000:3.0:1788448617.662983:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414080 00000100:00100000:3.0:1788448617.662992:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414592 00000100:00100000:3.0:1788448617.662994:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414592 00000100:00100000:3.0:1788448617.663003:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448617.663008:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826414464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.663041:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826414464:12345-0@lo:400:kworker.0 Request processed in 33us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663046:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448617.663057:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448617.663062:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826413952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.663086:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826413952:12345-0@lo:400:kworker.0 Request processed in 24us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663092:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448617.663102:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448617.663107:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3644:x1875323826414080:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788448617.663130:0:19178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1788448617.663157:0:19178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf45a9e4e6b804c2b 00002000:00100000:3.0:1788448617.663170:0:19178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9fc083fa0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788448617.663175:0:19178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788448617.663178:0:19178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788448617.663366:0:19178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788448617.663388:0:19178:0:(import.c:65:import_set_state_nolock()) ffff9fc083fa7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448617.663426:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3644:x1875323826414080:12345-0@lo:8:kworker.0 Request processed in 317us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663442:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448617.663457:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448617.663461:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3644:x1875323826414592:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788448617.663476:0:19178:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 535 last 0 00000020:00000080:3.0:1788448617.663492:0:19178:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xf45a9e4e6b804c32 00002000:00100000:3.0:1788448617.663499:0:19178:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9fc083fa4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788448617.663502:0:19178:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788448617.663504:0:19178:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788448617.663525:0:19178:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788448617.663538:0:19178:0:(import.c:65:import_set_state_nolock()) ffff9fc083fa3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448617.663566:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3644:x1875323826414592:12345-0@lo:8:kworker.0 Request processed in 103us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663572:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448617.663596:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415104 00000100:00100000:3.0:1788448617.663599:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415104 00000100:00100000:3.0:1788448617.663633:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414720 00000100:00100000:3.0:1788448617.663636:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414720 00000100:00100000:3.0:1788448617.663647:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415232 00000100:00100000:3.0:1788448617.663649:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415232 00000100:00100000:3.0:1788448617.663660:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448617.663665:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826415104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.663695:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826415104:12345-0@lo:400:kworker.0 Request processed in 29us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663699:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448617.663710:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448617.663716:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826414720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.663754:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826414720:12345-0@lo:400:kworker.0 Request processed in 38us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663760:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448617.663772:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448617.663778:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826415232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448617.663803:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826415232:12345-0@lo:400:kworker.0 Request processed in 27us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448617.663809:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788448617.663834:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448617.663839:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788448617.663870:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4897800 x1875323826414080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448617.663906:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788448617.663913:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788448617.663918:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788448617.663920:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc187ba0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788448617.663933:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788448617.663938:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875323826414080:0@lo:8:kworker.0 00010000:00080000:3.0:1788448617.663951:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4894700 x1875323826414592/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448642 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448617.663960:0:3644:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788448617.663964:0:3644:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788448617.663967:0:3644:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788448617.663969:0:3644:0:(import.c:65:import_set_state_nolock()) ffff9fc190ac4000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788448617.663979:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788448617.663982:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875323826414592:0@lo:8:kworker.0 00000004:00080000:3.0:1788448617.664036:0:17172:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788448617.664052:0:17172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1875323826415488:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788448617.664080:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.664098:0:17172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23600 going to sleep for 11 seconds 00000004:00080000:3.0:1788448617.664111:0:17171:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788448617.664167:0:17171:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 535009285006ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788448617.664173:0:17171:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1788448617.664206:0:17889:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788448617.664220:0:17889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17889:1875323826415744:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788448617.664242:0:17889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448617.664258:0:17889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448617.664427:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415488 00000100:00100000:3.0:1788448617.664432:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415488 00000100:00100000:3.0:1788448617.664462:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415744 00000100:00100000:3.0:1788448617.664465:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415744 00000100:00100000:3.0:1788448617.664478:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448617.664484:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17172:x1875323826415488:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788448617.664638:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448617.664646:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17889:x1875323826415744:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:3.0:1788448617.664673:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448617.664961:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826414208:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.664999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.665023:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826414848:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.665043:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.665059:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826415360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448617.665080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.665101:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:1.0:1788448617.665107:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826413696:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.665131:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.665158:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826414336:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.665181:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.665199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826414976:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.665231:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.665249:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826415616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448617.665269:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788448617.665302:0:17888:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788448617.665381:0:17888:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 535010499154ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788448617.665387:0:17888:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788448617.665409:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415360 00000100:00100000:1.0:1788448617.665413:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415360 00000100:00100000:1.0:1788448617.665436:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415616 00000100:00100000:1.0:1788448617.665438:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415616 00000100:00100000:1.0:1788448617.665452:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448617.665457:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826415360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448617.665477:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448617.665541:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875323826415360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.665548:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448617.665565:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448617.665570:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875323826415616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788448617.665580:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448617.665603:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3647:x1875323826415616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.665609:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448617.665626:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826413696 00000100:00100000:1.0:1788448617.665629:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826413696 00000100:00100000:1.0:1788448617.665654:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788448617.665660:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826413696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.665688:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826413696:12345-0@lo:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.665702:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788448617.665870:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414208 00000100:00100000:1.0:1788448617.665875:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414208 00000100:00100000:1.0:1788448617.665917:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414848 00000100:00100000:1.0:1788448617.665921:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414848 00000100:00100000:1.0:1788448617.665941:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414976 00000100:00100000:1.0:1788448617.665944:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414976 00000100:00100000:1.0:1788448617.665958:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448617.665964:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826414208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.665996:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826414208:12345-0@lo:400:kworker.0 Request processed in 32us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.666002:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448617.666047:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448617.666053:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826414848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.666081:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875323826414848:12345-0@lo:400:kworker.0 Request processed in 29us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.666087:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448617.666098:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448617.666104:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826414976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.666129:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875323826414976:12345-0@lo:400:kworker.0 Request processed in 26us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.666134:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1788448617.666174:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448617.666178:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448617.666252:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826414336 00000100:00100000:1.0:1788448617.666257:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826414336 00000100:00100000:1.0:1788448617.666283:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448617.666295:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826414336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.666329:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826414336:12345-0@lo:400:kworker.0 Request processed in 34us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.666350:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448617.666393:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826413696:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.666418:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826414336:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666458:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4896680 x1875323826414976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666468:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875323826414976:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666479:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f2a00 x1875323826415616/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666491:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826415616:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788448617.666501:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4897100 x1875323826414208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666508:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826414208:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666517:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4896a00 x1875323826414848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666525:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875323826414848:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666535:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1ba1f3b80 x1875323826415360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666545:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826415360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448617.666689:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826413952:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666711:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4894a80 x1875323826414720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666719:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826414720:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666734:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4897b80 x1875323826415232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666741:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826415232:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.666753:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826413824:0@lo:400:kworker.0 00000100:00100000:1.0:1788448617.666763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826414464:0@lo:400:kworker.0 00010000:00080000:1.0:1788448617.666777:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1b4894380 x1875323826415104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448633 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448617.666784:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826415104:0@lo:400:kworker.0 00000004:00080000:0.0:1788448617.673301:0:17878:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788448617.682664:0:19177:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1788448617.682678:0:19177:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788448617.682684:0:19177:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:3.0:1788448617.683099:0:17125:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788448617.697818:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.697830:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.697847:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.697851:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.697858:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.697876:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.697920:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.697928:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698119:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.698132:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.698138:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698146:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ec00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.698151:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698160:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698442:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698452:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0de57c0/0xf45a9e4e6b804c39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698472:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.698474:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.698476:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.698933:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.698939:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698949:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.698960:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.698965:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698976:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698985:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.698992:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699010:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.699019:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.699023:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699030:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.699034:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699042:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699053:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699071:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec339ecf/0xf45a9e4e6b804c40 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699085:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.699087:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.699089:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.699387:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.699393:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699402:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=535s v=(0 0) 00002000:00080000:1.0:1788448617.699404:0:18651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00010000:00010000:0.0:1788448617.699406:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00002000:00080000:1.0:1788448617.699412:0:18651:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00010000:00010000:0.0:1788448617.699413:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699426:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699434:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699442:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699456:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.699464:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.699474:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699481:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.699485:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699493:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448617.699504:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:17889:x1875323826415744:12345-0@lo:7:osp-pre-1-1.0 Request processed in 34855us (35257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.699514:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448617.699573:0:17889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17889:1875323826415744:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788448617.699586:0:17889:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00010000:00010000:0.0:1788448617.699603:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699610:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ead6598/0xf45a9e4e6b804c47 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.699625:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448617.699628:0:17889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17889:1875323826415872:0@lo:5:osp-pre-1-1.0 00010000:00010000:0.0:1788448617.699628:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.699631:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448617.699670:0:17889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.699691:0:17889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448617.699708:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826415872 00000100:00100000:1.0:1788448617.699714:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826415872 00000100:00100000:1.0:1788448617.699755:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448617.699763:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17889:x1875323826415872:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788448617.699785:0:18652:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788448617.699815:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17889:x1875323826415872:12345-0@lo:5:osp-pre-1-1.0 Request processed in 53us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448617.699820:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448617.699852:0:17889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17889:1875323826415872:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788448617.699861:0:17889:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788448617.699902:0:17889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17889:1875323826416000:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788448617.699924:0:17889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.699938:0:17889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448617.699950:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416000 00000100:00100000:1.0:1788448617.699953:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416000 00000100:00100000:1.0:1788448617.699972:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448617.699978:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17889:x1875323826416000:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788448617.699999:0:19178:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1788448617.700078:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.700084:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700093:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.700096:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.700101:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700122:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700131:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700138:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700153:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.700162:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.700166:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700173:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.700176:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700184:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700194:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700201:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051bd1b03/0xf45a9e4e6b804c4e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700367:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.700369:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.700371:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.700750:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.700757:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700765:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.700769:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.700773:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700783:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700791:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700798:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.700816:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788448617.701079:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.701086:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701107:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.701110:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.701115:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701123:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701131:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701137:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701152:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788448617.701162:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448617.701166:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701172:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.701176:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701183:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701204:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701269:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a9d668a/0xf45a9e4e6b804c55 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701285:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.701288:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701295:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.701298:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701305:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701314:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701321:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c8068ef/0xf45a9e4e6b804c5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701332:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.701333:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.701351:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.701653:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.701659:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701668:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.701671:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.701675:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701685:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701692:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701699:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701713:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.701720:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.701724:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701731:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ee00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.701734:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701753:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701764:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701771:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4b74c5a/0xf45a9e4e6b804c63 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.701784:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.701786:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.701787:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.702036:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.702042:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702051:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.702054:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.702058:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702067:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702075:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702089:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702103:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.702110:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.702114:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702120:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.702123:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702130:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702141:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702148:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daca2270/0xf45a9e4e6b804c6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702160:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.702162:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.702163:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.702560:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.702574:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702585:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.702588:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.702593:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702603:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702611:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702618:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702633:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.702640:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.702644:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702651:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1e000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.702653:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702660:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702677:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702685:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064a5722a/0xf45a9e4e6b804c71 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.702698:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.702700:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.702702:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.702991:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.702997:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703005:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.703009:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.703013:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703022:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703029:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703036:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703060:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.703067:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.703071:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703077:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.703080:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703087:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703098:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703105:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000103690eb/0xf45a9e4e6b804c78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703119:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.703121:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.703122:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.703449:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.703455:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703463:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.703472:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.703476:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703485:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703492:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703549:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703564:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.703572:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.703575:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703582:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1ea00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.703586:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703593:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703604:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703622:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6d7ed82/0xf45a9e4e6b804c7f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703637:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.703638:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.703640:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.703945:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.703951:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703959:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.703962:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.703966:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703974:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703982:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.703989:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704003:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.704010:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.704019:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704026:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.704029:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704037:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704048:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704056:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b229577/0xf45a9e4e6b804c86 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704070:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.704072:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.704073:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.704316:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.704322:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704331:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.704345:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.704350:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704372:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704381:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704388:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704401:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.704408:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.704412:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704418:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204aa00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.704421:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704429:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704440:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704448:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f3377ef/0xf45a9e4e6b804c8d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.704469:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.704471:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.704473:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.704633:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.705384:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.705392:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.705402:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.705405:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.705410:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.705421:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.705430:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.705437:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.705460:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448617.705588:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448617.705594:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.705602:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204bc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448617.705605:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.705613:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.705635:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.705642:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc4f5dd5/0xf45a9e4e6b804c94 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.705661:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.705663:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.705664:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.706091:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.706097:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706117:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.706120:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.706126:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706137:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706145:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706152:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706205:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788448617.706527:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.706533:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706542:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.706545:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.706549:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706558:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706578:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.706585:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706657:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448617.706663:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706671:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204be00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448617.706675:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706682:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706696:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706703:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000daf22adf/0xf45a9e4e6b804c9b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706730:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448617.706733:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706740:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a600 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448617.706744:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706751:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706761:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.706769:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.706770:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.706772:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.706840:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788448617.706846:0:19177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000850820e9/0xf45a9e4e6b804ca2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.707048:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.707399:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.707405:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.707415:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.707418:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.707422:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.707432:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.707440:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.707459:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.707480:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448617.707758:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448617.707764:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.707772:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448617.707775:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.707795:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.707808:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.707815:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000940d7246/0xf45a9e4e6b804ca9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.707831:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.707833:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.707834:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.708087:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.708094:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708103:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.708106:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.708111:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708120:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708128:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708136:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708154:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788448617.708634:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.708641:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708657:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=535s v=(0 0) 00010000:00010000:2.0:1788448617.708660:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.708661:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448617.708670:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708670:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.708694:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ae00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.708697:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.708699:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708708:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.708721:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708723:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.708751:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708753:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448617.708764:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e19b33a/0xf45a9e4e6b804cb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.708764:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448617.708785:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.708787:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.708789:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.713133:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.713146:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713162:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.713167:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.713173:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713186:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713203:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713210:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713228:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.713454:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.713461:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713469:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b200 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.713474:0:19726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713483:0:19726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713502:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713510:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dff4bf4a/0xf45a9e4e6b804cbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713533:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713546:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.713550:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713559:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713570:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713578:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.713593:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.713595:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.713597:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.713601:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.713603:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.713604:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788448617.715235:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.715245:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715262:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.715267:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.715275:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715293:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715307:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715317:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715345:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.715355:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.715359:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715370:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.715374:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715386:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715399:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715406:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.715431:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.715435:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.715437:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448617.716198:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448617.716211:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716226:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788448617.716231:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448617.716239:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716252:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716264:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716277:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716295:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788448617.716654:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448617.716661:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716674:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788448617.716677:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448617.716681:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.716693:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.716847:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.716854:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.716863:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.716868:0:19726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.716876:0:19726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.716911:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.716918:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c528d22/0xf45a9e4e6b804ccc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.716933:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.716934:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.716936:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.717105:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.717120:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.717137:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448617.717195:0:17133:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448617.717200:0:17133:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.717348:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.718450:0:17133:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fcc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448617.718455:0:17133:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.718464:0:17133:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.718479:0:17133:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.718486:0:17133:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750cb6c5/0xf45a9e4e6b804cd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.718504:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.718505:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448617.718507:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448617.719100:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448617.719108:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.719125:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788448617.719129:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448617.719135:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.719147:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.719156:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.719164:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.719180:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448617.720323:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448617.720333:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.720432:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fde00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448617.720438:0:19726:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.720446:0:19726:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.720463:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.720482:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad116af6/0xf45a9e4e6b804cda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.720715:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.720718:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.720720:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448617.723764:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448617.723776:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.723792:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788448617.723796:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448617.723802:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.723815:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.723837:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.724038:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.724094:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788448617.724448:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788448617.724454:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.724463:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=535s v=(0 0) 00010000:00010000:1.0:1788448617.724466:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448617.724470:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.724479:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.724487:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448617.724507:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726235:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448617.726248:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726260:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448617.726265:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726275:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726294:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726301:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd0e892a/0xf45a9e4e6b804ce1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726325:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448617.726328:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726354:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fdc00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448617.726358:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726367:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726376:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.726439:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.726441:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.726443:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448617.726738:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788448617.726746:0:19177:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d699b24/0xf45a9e4e6b804ce8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.726927:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788448617.728509:0:19465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1788448617.728548:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1788448617.728553:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1788448617.729407:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.729418:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.729436:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.729440:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.729458:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.729473:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.729484:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.729493:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.729520:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788448617.729738:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:17889:x1875323826416000:12345-0@lo:5:osp-pre-1-1.0 Request processed in 29754us (29808us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788448617.729749:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00002000:00010000:0.0:1788448617.729971:0:19177:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788448617.729977:0:19177:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.729985:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=535s v=(0 0) 00010000:00010000:0.0:1788448617.729988:0:19177:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448617.729991:0:19177:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.730000:0:19177:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.730009:0:19177:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.730027:0:19177:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448617.730046:0:19177:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:0.0:1788448617.730081:0:19177:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1788448617.730138:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17172:x1875323826415488:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65653us (66057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448617.730146:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448617.730212:0:17172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1875323826415488:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788448617.730226:0:17172:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788448617.730266:0:17172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1875323826416128:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788448617.730298:0:17172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448617.730325:0:17172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448617.730580:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416128 00000100:00100000:0.0:1788448617.730588:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416128 00000100:00100000:0.0:1788448617.730669:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448617.730679:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17172:x1875323826416128:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788448617.730712:0:18652:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000100:00100000:2.0:1788448617.730730:0:17889:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788448617.730736:0:17889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17889:1875323826416000:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788448617.730745:0:17889:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788448617.730772:0:17889:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17889:1875323826416256:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788448617.730801:0:17889:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448617.730818:0:17889:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc196b3e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448617.732013:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416256 00000100:00100000:2.0:1788448617.732024:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416256 00000100:00100000:2.0:1788448617.732075:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448617.732083:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17889:x1875323826416256:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788448617.732150:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17889:x1875323826416256:12345-0@lo:900:osp-pre-1-1.0 Request processed in 67us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448617.732164:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788448617.732188:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448617.732195:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732207:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448617.732211:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732220:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732239:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732246:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000576fb72b/0xf45a9e4e6b804cef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732267:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448617.732270:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732276:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:2.0:1788448617.732279:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732296:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732306:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732313:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90c4da9/0xf45a9e4e6b804cf6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19177 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448617.732325:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.732327:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448617.732328:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:2.0:1788448617.732366:0:17889:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc083e20000 x1875323826416256/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788448633 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448617.732378:0:17889:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e20000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17889:1875323826416256:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788448617.732464:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448617.735677:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17172:x1875323826416128:12345-0@lo:5:osp-pre-1-0.0 Request processed in 4993us (5372us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788448617.735690:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448617.737798:0:17172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17172:1875323826416128:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788448617.737822:0:17172:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1788448618.176673:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448619.198044:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448619.837572:0:19823:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788448620.230821:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448620.734259:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448620.734289:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826416384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448620.734373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448620.734672:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416384 00000100:00100000:3.0:1788448620.734680:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416384 00000100:00100000:3.0:1788448620.734736:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788448620.734746:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826416384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448620.734787:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448620.734840:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826416384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448620.734847:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448620.735206:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826416384:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448620.735533:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826416512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448620.735567:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448620.735634:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416512 00000100:00100000:3.0:1788448620.735638:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416512 00000100:00100000:3.0:1788448620.735671:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448620.735677:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826416512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448620.735696:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788448620.735729:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826416512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448620.735734:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448620.735804:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826416512:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788448621.001838:0:19875:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788448621.002067:0:19875:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788448621.246182:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448621.246213:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826416640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448621.246280:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448621.246452:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416640 00000100:00100000:0.0:1788448621.246460:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416640 00000100:00100000:0.0:1788448621.246519:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788448621.246527:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448621.246531:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826416640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448621.246573:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788448621.246607:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826416768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448621.246640:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448621.246663:0:18653:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788448621.246672:0:18653:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00010000:00010000:1.0:1788448621.246689:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448621.250214:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416768 00000100:00100000:1.0:1788448621.250224:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416768 00000100:00080000:1.0:1788448621.250294:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448621.250576:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826416640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4045us (4291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448621.250586:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448621.250611:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448621.250620:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826416768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788448621.250643:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788448621.250697:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826416768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (4057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448621.250703:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448621.254096:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826416640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448621.254274:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826416768:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1788448621.759873:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448622.270006:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788448622.308230:0:19926:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788448622.309490:0:19926:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788448622.620793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.620929:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161216 00000100:00100000:2.0:1788448622.620942:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161216 00000100:00100000:2.0:1788448622.620998:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:2.0:1788448622.621017:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2397:x1875323801161216:12345-192.168.206.21@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788448622.621053:0:17139:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 712f63d1-2d07-4fc2-9551-3a10ea985aa1@192.168.206.21@tcp t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:2.0:1788448622.621095:0:17139:0:(genops.c:1385:class_connect()) connect: client 712f63d1-2d07-4fc2-9551-3a10ea985aa1, cookie 0xf45a9e4e6b804cfd 00000100:00080000:2.0:1788448622.621301:0:17139:0:(import.c:65:import_set_state_nolock()) ffff9fc08221f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448622.621401:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+5:2397:x1875323801161216:12345-192.168.206.21@tcp:250:mount.lustre.0 Request processed in 392us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.621410:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:2.0:1788448622.625602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.625708:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161344 00000100:00100000:1.0:1788448622.625721:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161344 00000100:00100000:1.0:1788448622.625783:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:1.0:1788448622.625809:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+5:14901:x1875323801161344:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448622.625827:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448622.625845:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b804d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e098f expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448622.625875:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b804d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e098f expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448622.625930:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fc600/0xf45a9e4e6b804d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e098f expref: 6 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448622.625939:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc600, rc 0) 00000100:00100000:0.0:1788448622.626086:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+6:14901:x1875323801161344:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 267us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.626100:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1788448622.629050:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.629373:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161472 00000100:00100000:1.0:1788448622.629386:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161472 00000100:00100000:1.0:1788448622.629454:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:1.0:1788448622.629466:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+6:14901:x1875323801161472:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788448622.629680:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+6:14901:x1875323801161472:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 214us (644us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448622.629690:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:2.0:1788448622.632086:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448622.632251:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161600 00000100:00100000:0.0:1788448622.632262:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161600 00000100:00100000:0.0:1788448622.632379:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:0.0:1788448622.632390:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+6:14901:x1875323801161600:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448622.632411:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448622.632434:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204ba00/0xf45a9e4e6b804d0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0996 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.632466:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204ba00/0xf45a9e4e6b804d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0996 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.632478:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204ba00/0xf45a9e4e6b804d0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0996 expref: 7 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.632505:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204ba00, rc 0) 00000100:00100000:0.0:1788448622.632576:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+7:14901:x1875323801161600:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 187us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.632583:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:3.0:1788448622.634385:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.634586:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161728 00000100:00100000:2.0:1788448622.634596:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161728 00000100:00100000:2.0:1788448622.634675:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:2.0:1788448622.634690:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+7:14901:x1875323801161728:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788448622.635071:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14901:x1875323801161728:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 384us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.635080:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:3.0:1788448622.637465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448622.637533:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161856 00000100:00100000:0.0:1788448622.637544:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161856 00000100:00100000:0.0:1788448622.637606:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:0.0:1788448622.637617:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14901:x1875323801161856:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788448622.637914:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14901:x1875323801161856:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 296us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.637923:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:3.0:1788448622.641944:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.642251:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801161984 00000100:00100000:2.0:1788448622.642262:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801161984 00000100:00100000:2.0:1788448622.642363:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:2.0:1788448622.642378:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14919:x1875323801161984:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448622.642578:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14919:x1875323801161984:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 204us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.642594:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:2.0:1788448622.664578:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448622.664712:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162112 00000100:00100000:0.0:1788448622.664730:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162112 00000100:00100000:0.0:1788448622.664858:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:0.0:1788448622.664872:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14919:x1875323801162112:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448622.665109:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14919:x1875323801162112:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 239us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.665118:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:1.0:1788448622.667600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.667963:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162240 00000100:00100000:2.0:1788448622.667975:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162240 00000100:00100000:2.0:1788448622.668121:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:2.0:1788448622.668136:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14919:x1875323801162240:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448622.668457:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14919:x1875323801162240:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 324us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.668467:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:3.0:1788448622.674581:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448622.674733:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162368 00000100:00100000:0.0:1788448622.674747:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162368 00000100:00100000:0.0:1788448622.674869:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1788448622.674929:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+8:14901:x1875323801162368:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448622.674951:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448622.674987:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204aa00/0xf45a9e4e6b804d12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e09c7 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.675049:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204aa00/0xf45a9e4e6b804d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09c7 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.675063:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204aa00/0xf45a9e4e6b804d12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09c7 expref: 9 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.675075:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204aa00, rc 0) 00000100:00100000:0.0:1788448622.675156:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+9:14901:x1875323801162368:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 273us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.675165:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1788448622.677583:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.677693:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162496 00000100:00100000:2.0:1788448622.677705:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162496 00000100:00100000:2.0:1788448622.677786:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:2.0:1788448622.677800:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+9:14901:x1875323801162496:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788448622.677829:0:17139:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788448622.677859:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788448622.677864:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788448622.677868:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788448622.677871:0:17139:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788448622.677873:0:17139:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788448622.681118:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+9:14901:x1875323801162496:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 3307us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.681136:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:3.0:1788448622.685113:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448622.685266:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162624 00000100:00100000:0.0:1788448622.685279:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162624 00000100:00100000:0.0:1788448622.685363:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:0.0:1788448622.685430:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+9:14901:x1875323801162624:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448622.685452:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448622.685475:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e09ce expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.685512:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.685523:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 10 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448622.685532:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b200, rc 0) 00000100:00100000:0.0:1788448622.685623:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14901:x1875323801162624:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 250us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.685645:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:0.0:1788448622.687287:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.687403:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162752 00000100:00100000:2.0:1788448622.687412:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162752 00000100:00100000:2.0:1788448622.687546:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:2.0:1788448622.687562:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14901:x1875323801162752:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788448622.687761:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14901:x1875323801162752:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 205us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.687769:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 126 00000100:00100000:3.0:1788448622.689329:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.689528:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801162880 00000100:00100000:1.0:1788448622.689546:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801162880 00000100:00100000:1.0:1788448622.689593:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:1.0:1788448622.689604:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14901:x1875323801162880:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788448622.689825:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14901:x1875323801162880:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 223us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.689843:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 127 00000100:00100000:2.0:1788448622.693077:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448622.693215:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163008 00000100:00100000:0.0:1788448622.693227:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163008 00000100:00100000:0.0:1788448622.693334:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:0.0:1788448622.693345:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14924:x1875323801163008:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448622.693536:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14924:x1875323801163008:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 192us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.693545:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 128 00000100:00100000:0.0:1788448622.695922:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.696007:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163136 00000100:00100000:1.0:1788448622.696018:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163136 00000100:00100000:1.0:1788448622.696085:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:1.0:1788448622.696097:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14924:x1875323801163136:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448622.699146:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:14924:x1875323801163136:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 3035us (3219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.699167:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 129 00000100:00100000:3.0:1788448622.708454:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448622.708795:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.709056:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163264 00000100:00100000:1.0:1788448622.709069:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163264 00000100:00100000:1.0:1788448622.709121:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163520 00000100:00100000:1.0:1788448622.709124:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163520 00000100:00100000:1.0:1788448622.709159:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448622.709169:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2397:x1875323801163264:12345-192.168.206.21@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788448622.709331:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1788448622.709338:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875323801163520:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788448622.710125:0:17145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 03254173-b90a-4634-8f44-6b5b52d8ff13@192.168.206.21@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788448622.710205:0:17145:0:(genops.c:1385:class_connect()) connect: client 03254173-b90a-4634-8f44-6b5b52d8ff13, cookie 0xf45a9e4e6b804d20 00000004:00100000:1.0:1788448622.710236:0:17145:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788448622.710500:0:17145:0:(import.c:65:import_set_state_nolock()) ffff9fc187515800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448622.710586:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2397:x1875323801163264:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 1417us (2147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.710595:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00010000:00080000:0.0:1788448622.710956:0:19479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 03254173-b90a-4634-8f44-6b5b52d8ff13@192.168.206.21@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:0.0:1788448622.711003:0:19479:0:(genops.c:1385:class_connect()) connect: client 03254173-b90a-4634-8f44-6b5b52d8ff13, cookie 0xf45a9e4e6b804d27 00000004:00100000:0.0:1788448622.711020:0:19479:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788448622.711196:0:19479:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448622.711365:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2397:x1875323801163520:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 2024us (2569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.711374:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1788448622.717503:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448622.717551:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448622.717591:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.717693:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163648 00000100:00100000:2.0:1788448622.717706:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163648 00000100:00100000:2.0:1788448622.717786:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163392 00000100:00100000:2.0:1788448622.717790:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163392 00000100:00100000:2.0:1788448622.717807:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163776 00000100:00100000:2.0:1788448622.717810:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163776 00000100:00100000:2.0:1788448622.717846:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448622.717858:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:0:x1875323801163648:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788448622.717949:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788448622.718047:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:0:x1875323801163648:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 191us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.718055:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448622.718086:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:2.0:1788448622.718095:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+7:0:x1875323801163392:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788448622.718114:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788448622.718155:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+7:0:x1875323801163392:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 63us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.718161:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:2.0:1788448622.718173:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1788448622.718182:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801163776:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788448622.718205:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788448622.718245:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801163776:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 66us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.718251:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00080000:3.0:1788448622.719022:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448622.719029:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448622.728471:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.728702:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801163904 00000100:00100000:1.0:1788448622.728716:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801163904 00000100:00100000:1.0:1788448622.729048:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448622.729063:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801163904:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788448622.729429:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801163904:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 369us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.729438:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1788448622.737996:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.738111:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.738151:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.738456:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164032 00000100:00100000:1.0:1788448622.738470:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164032 00000100:00100000:1.0:1788448622.738525:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164160 00000100:00100000:1.0:1788448622.738528:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164160 00000100:00100000:1.0:1788448622.738552:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1788448622.738563:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875323801164032:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788448622.738622:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 03254173-b90a-4634-8f44-6b5b52d8ff13@192.168.206.21@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788448622.738665:0:18651:0:(genops.c:1385:class_connect()) connect: client 03254173-b90a-4634-8f44-6b5b52d8ff13, cookie 0xf45a9e4e6b804d2e 00002000:00100000:1.0:1788448622.738679:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 03254173-b90a-4634-8f44-6b5b52d8ff13/ffff9fc187510800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448622.738703:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788448622.738966:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788448622.739003:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9fc1bb1e3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448622.739090:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2397:x1875323801164032:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 527us (978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.739099:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1788448622.739124:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788448622.739129:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875323801164160:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788448622.739149:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 03254173-b90a-4634-8f44-6b5b52d8ff13@192.168.206.21@tcp t0 exp 0000000000000000 cur 540 last 0 00000020:00000080:1.0:1788448622.739170:0:18651:0:(genops.c:1385:class_connect()) connect: client 03254173-b90a-4634-8f44-6b5b52d8ff13, cookie 0xf45a9e4e6b804d35 00002000:00100000:1.0:1788448622.739177:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 03254173-b90a-4634-8f44-6b5b52d8ff13/ffff9fc1ba060000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448622.739190:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788448622.739359:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788448622.739375:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9fc1ba063000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448622.739400:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2397:x1875323801164160:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 269us (1248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.739407:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1788448622.741775:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164288 00000100:00100000:0.0:1788448622.741792:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164288 00000100:00100000:0.0:1788448622.741870:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:0.0:1788448622.741898:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801164288:12345-192.168.206.21@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788448622.741999:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801164288:12345-192.168.206.21@tcp:900:mount.lustre.0 Request processed in 119us (4019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.742025:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:2.0:1788448622.747999:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448622.748456:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164416 00000100:00100000:1.0:1788448622.748469:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164416 00000100:00100000:1.0:1788448622.748583:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448622.748606:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801164416:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788448622.752079:0:17148:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3336us 00000001:00100000:1.0:1788448622.760041:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000001:00080000:1.0:1788448622.760060:0:19465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00200000:3.0:1788448622.768092:0:17148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788448622.768264:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14901:x1875323801164416:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 19662us (20273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448622.768281:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:0.0:1788448622.782547:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826417024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448622.782668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.782749:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448622.782757:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826416896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448622.782789:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.782829:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417024 00000100:00100000:0.0:1788448622.782839:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417024 00000100:00100000:0.0:1788448622.782922:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826416896 00000100:00100000:0.0:1788448622.782926:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826416896 00000100:00100000:0.0:1788448622.782947:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448622.782957:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826417024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788448622.782985:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448622.783035:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826417024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.783043:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448622.783063:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448622.783069:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826416896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448622.783079:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448622.783103:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826416896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.783109:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788448622.783126:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448622.783160:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788448622.783203:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826416896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448622.783241:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826417024:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448622.784818:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826417536:0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.784910:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.784945:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826418048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.784968:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.784990:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788448622.784994:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826417408:0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.785046:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826417920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785068:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.785082:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826418432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785107:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448622.785217:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417536 00000100:00100000:0.0:1788448622.785224:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417536 00000100:00100000:0.0:1788448622.785264:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418048 00000100:00100000:0.0:1788448622.785267:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418048 00000100:00100000:0.0:1788448622.785293:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417920 00000100:00100000:0.0:1788448622.785295:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417920 00000100:00100000:0.0:1788448622.785306:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418432 00000100:00100000:0.0:1788448622.785318:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418432 00000100:00100000:0.0:1788448622.785339:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448622.785348:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826417536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785412:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875323826417536:12345-0@lo:400:kworker.0 Request processed in 64us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.785420:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448622.785440:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448622.785462:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826418048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785490:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875323826418048:12345-0@lo:400:kworker.0 Request processed in 30us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.785496:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448622.785507:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448622.785513:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826417920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785534:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875323826417920:12345-0@lo:400:kworker.0 Request processed in 22us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.785539:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448622.785550:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448622.785556:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826418432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785580:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875323826418432:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.785586:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448622.785605:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417408 00000100:00100000:0.0:1788448622.785609:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417408 00000100:00100000:0.0:1788448622.785633:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448622.785638:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826417408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.785684:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826417408:12345-0@lo:400:kworker.0 Request processed in 46us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.785691:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788448622.785708:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448622.785713:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448622.785747:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826417408:0@lo:400:kworker.0 00010000:00080000:0.0:1788448622.785763:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341e300 x1875323826417920/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448622.785785:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875323826417920:0@lo:400:kworker.0 00010000:00080000:0.0:1788448622.785796:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836ea300 x1875323826418432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448622.785805:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875323826418432:0@lo:400:kworker.0 00010000:00080000:0.0:1788448622.785814:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341dc00 x1875323826417536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448622.785822:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875323826417536:0@lo:400:kworker.0 00010000:00080000:0.0:1788448622.785832:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9180 x1875323826418048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448622.785840:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875323826418048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786194:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826417280:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786240:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448622.786285:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826417792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786318:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448622.786339:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826418304:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786361:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448622.786379:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788448622.786386:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826417152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786412:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448622.786429:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826417664:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786447:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448622.786461:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826418176:0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786481:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448622.786523:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417792 00000100:00100000:1.0:1788448622.786528:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417792 00000100:00100000:1.0:1788448622.786563:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448622.786570:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826417792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448622.786626:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826417792:12345-0@lo:400:kworker.0 Request processed in 56us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448622.786633:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448622.786665:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826417792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448622.787356:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418304 00000100:00100000:2.0:1788448622.787364:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418304 00000100:00100000:2.0:1788448622.787418:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418176 00000100:00100000:2.0:1788448622.787422:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418176 00000100:00100000:2.0:1788448622.787444:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448622.787452:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826418304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448622.787515:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875323826418304:12345-0@lo:400:kworker.0 Request processed in 64us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.787521:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448622.787537:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448622.787546:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826418176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448622.787573:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826418176:12345-0@lo:400:kworker.0 Request processed in 31us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.787579:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448622.787713:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417280 00000100:00100000:2.0:1788448622.787718:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417280 00000100:00100000:2.0:1788448622.787741:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417664 00000100:00100000:2.0:1788448622.787744:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417664 00000100:00100000:2.0:1788448622.787758:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448622.787765:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826417280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448622.787813:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826417280:12345-0@lo:400:kworker.0 Request processed in 49us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.787820:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448622.787833:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448622.787842:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826417664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448622.787868:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826417664:12345-0@lo:400:kworker.0 Request processed in 29us (1419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.787873:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:1.0:1788448622.788044:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448622.788049:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448622.788267:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826417664:0@lo:400:kworker.0 00010000:00080000:2.0:1788448622.788289:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e8a80 x1875323826418176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448622.788300:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826418176:0@lo:400:kworker.0 00000100:00100000:2.0:1788448622.788322:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826417280:0@lo:400:kworker.0 00010000:00080000:2.0:1788448622.788335:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0836e9880 x1875323826418304/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448622.788344:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875323826418304:0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.788547:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826417152 00000100:00100000:0.0:1788448622.788554:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826417152 00000100:00100000:0.0:1788448622.789347:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788448622.789360:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826417152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448622.789457:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826417152:12345-0@lo:400:kworker.0 Request processed in 100us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448622.789464:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448622.789542:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826417152:0@lo:400:kworker.0 00000100:00100000:3.0:1788448622.987634:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448622.987830:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164544 00000100:00100000:2.0:1788448622.987844:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164544 00000100:00100000:2.0:1788448622.987994:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1788448622.988010:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14947:x1875323801164544:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:2.0:1788448622.988037:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448622.988072:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804d3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e09ff expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448622.988820:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804d43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448622.988843:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804d43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448622.988864:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804d43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448622.988962:0:19479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448622.988967:0:19479:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448622.989015:0:19479:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804d43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448622.989053:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0331c00/0xf45a9e4e6b804d3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ff expref: 8 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448622.989078:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804d43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ff expref: 7 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448622.989088:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:2.0:1788448622.989091:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448622.989095:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0330000, rc 0) 00000100:00100000:2.0:1788448622.989822:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+7:14947:x1875323801164544:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 1812us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448622.989834:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00010000:00010000:0.0:1788448623.295600:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448624.318085:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448625.184416:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.184554:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164672 00000100:00100000:0.0:1788448625.184564:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164672 00000100:00100000:0.0:1788448625.184649:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1788448625.184666:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+7:14999:x1875323801164672:12345-192.168.206.21@tcp:41:lfs.0 00000100:00080000:1.0:1788448625.184697:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788448625.184943:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788448625.185460:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+7:14999:x1875323801164672:12345-192.168.206.21@tcp:41:lfs.0 Request processed in 798us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.185470:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1788448625.188395:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.188855:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164800 00000100:00100000:3.0:1788448625.188864:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164800 00000100:00100000:3.0:1788448625.189360:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:3.0:1788448625.189372:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14999:x1875323801164800:12345-192.168.206.21@tcp:41:lfs.0 00000004:00000024:3.0:1788448625.189405:0:17147:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448625.189482:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0835d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14999:x1875323801164800:12345-192.168.206.21@tcp:41:lfs.0 Request processed in 113us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.189489:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1788448625.197911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.198065:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801164928 00000100:00100000:0.0:1788448625.198078:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801164928 00000100:00100000:0.0:1788448625.209360:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448625.209385:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14999:x1875323801164928:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:0.0:1788448625.209430:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788448625.209561:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03254173-b90a-4634-8f44-6b5b52d8ff13+6:14999:x1875323801164928:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 178us (11673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.209571:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:0.0:1788448625.212852:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.213339:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165056 00000100:00100000:2.0:1788448625.213373:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165056 00000100:00080000:1.0:1788448625.216677:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448625.216698:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448625.216702:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788448625.218347:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:2.0:1788448625.218393:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03254173-b90a-4634-8f44-6b5b52d8ff13+5:14999:x1875323801165056:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:2.0:1788448625.218437:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788448625.218560:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:03254173-b90a-4634-8f44-6b5b52d8ff13+5:14999:x1875323801165056:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 198us (5723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.231579:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00010000:00010000:1.0:1788448625.342455:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448625.390102:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448625.392561:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165184 00000100:00100000:1.0:1788448625.392581:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165184 00000100:00100000:1.0:1788448625.392682:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:1.0:1788448625.392696:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc191cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+10:15033:x1875323801165184:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448625.392717:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448625.392743:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b804d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a06 expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.392781:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b804d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a06 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.392794:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fcc00/0xf45a9e4e6b804d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a06 expref: 11 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.392824:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fcc00, rc 0) 00000100:00100000:1.0:1788448625.393009:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc191cf0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15033:x1875323801165184:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 315us (2921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.393018:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 131 00000100:00100000:3.0:1788448625.397013:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.398171:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165312 00000100:00100000:0.0:1788448625.398189:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165312 00000100:00100000:0.0:1788448625.398287:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:0.0:1788448625.398312:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15033:x1875323801165312:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448625.399646:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15033:x1875323801165312:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 1327us (2639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.399661:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 132 00000100:00100000:0.0:1788448625.402602:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.402678:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165440 00000100:00100000:2.0:1788448625.402691:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165440 00000100:00100000:2.0:1788448625.402838:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:2.0:1788448625.402854:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15033:x1875323801165440:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788448625.403087:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15033:x1875323801165440:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 238us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.403096:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 133 00000100:00100000:3.0:1788448625.407568:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.407872:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165568 00000100:00100000:0.0:1788448625.407939:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165568 00000100:00100000:0.0:1788448625.408006:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:0.0:1788448625.408017:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15038:x1875323801165568:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448625.408327:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15038:x1875323801165568:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 311us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.408337:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 134 00000100:00100000:3.0:1788448625.421753:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.424096:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165696 00000100:00100000:2.0:1788448625.424118:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165696 00000100:00100000:2.0:1788448625.424308:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:2.0:1788448625.424325:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15038:x1875323801165696:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448625.424687:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15038:x1875323801165696:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 366us (2948us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.424697:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 135 00000100:00100000:3.0:1788448625.429756:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448625.430112:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165824 00000100:00100000:1.0:1788448625.430125:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165824 00000100:00100000:1.0:1788448625.430705:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:1.0:1788448625.430718:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15038:x1875323801165824:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448625.430952:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15038:x1875323801165824:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 237us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.430961:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 136 00000100:00100000:3.0:1788448625.433068:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.433693:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801165952 00000100:00100000:0.0:1788448625.433709:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801165952 00000100:00100000:0.0:1788448625.433773:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:0.0:1788448625.433785:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:15033:x1875323801165952:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448625.433808:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448625.434081:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204bc00/0xf45a9e4e6b804d51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a37 expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.434126:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204bc00/0xf45a9e4e6b804d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a37 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.434140:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204bc00/0xf45a9e4e6b804d51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a37 expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.434151:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204bc00, rc 0) 00000100:00100000:0.0:1788448625.434221:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:15033:x1875323801165952:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 439us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.434229:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 137 00000100:00100000:3.0:1788448625.436376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448625.436584:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166080 00000100:00100000:1.0:1788448625.436596:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166080 00000100:00100000:1.0:1788448625.436665:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:1.0:1788448625.436677:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:15033:x1875323801166080:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788448625.436710:0:17140:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788448625.436755:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788448625.436760:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788448625.436763:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788448625.436767:0:17140:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788448625.436773:0:17140:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788448625.438051:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:15033:x1875323801166080:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 1367us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.438067:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 138 00000100:00100000:3.0:1788448625.442243:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.442330:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166208 00000100:00100000:0.0:1788448625.442345:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166208 00000100:00100000:0.0:1788448625.442421:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:0.0:1788448625.442434:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:15033:x1875323801166208:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448625.442522:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448625.442579:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a3e expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.442626:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.442638:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.442803:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204be00, rc 0) 00000100:00100000:0.0:1788448625.442910:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15033:x1875323801166208:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 478us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.442917:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 139 00000100:00100000:3.0:1788448625.445848:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448625.446332:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166336 00000100:00100000:1.0:1788448625.446355:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166336 00000100:00100000:1.0:1788448625.446431:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:1.0:1788448625.446444:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15033:x1875323801166336:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788448625.446667:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15033:x1875323801166336:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 224us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.446677:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 140 00000100:00100000:3.0:1788448625.449801:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.449915:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166464 00000100:00100000:0.0:1788448625.449927:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166464 00000100:00100000:0.0:1788448625.449996:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:0.0:1788448625.450017:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15033:x1875323801166464:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788448625.450216:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15033:x1875323801166464:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 200us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.450226:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 141 00000100:00100000:3.0:1788448625.452998:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.453176:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166592 00000100:00100000:2.0:1788448625.453188:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166592 00000100:00100000:1.0:1788448625.453420:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:1.0:1788448625.453436:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15044:x1875323801166592:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448625.453677:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15044:x1875323801166592:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 244us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.453686:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 142 00000100:00100000:3.0:1788448625.461352:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.464977:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166720 00000100:00100000:0.0:1788448625.465001:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166720 00000100:00100000:0.0:1788448625.465095:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:0.0:1788448625.465109:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15044:x1875323801166720:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448625.465454:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:15044:x1875323801166720:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 346us (4117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.465464:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 143 00000100:00100000:3.0:1788448625.472827:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.472931:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.472968:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.473105:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166976 00000100:00100000:2.0:1788448625.473120:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166976 00000100:00100000:2.0:1788448625.473217:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167104 00000100:00100000:2.0:1788448625.473238:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167104 00000100:00100000:2.0:1788448625.473272:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:2.0:1788448625.473285:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2401:x1875323801166976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448625.473394:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2401:x1875323801166976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 112us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.473403:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:2.0:1788448625.473423:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:2.0:1788448625.473433:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2401:x1875323801167104:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448625.473458:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2401:x1875323801167104:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.473464:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:1.0:1788448625.473718:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167232 00000100:00100000:1.0:1788448625.473723:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167232 00000100:00100000:1.0:1788448625.473767:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448625.473775:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2401:x1875323801167232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448625.473808:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2401:x1875323801167232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.473814:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:3.0:1788448625.475535:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.475814:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167360 00000100:00100000:0.0:1788448625.475824:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167360 00000100:00100000:0.0:1788448625.475914:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1788448625.475926:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801167360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448625.476012:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801167360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.476020:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:3.0:1788448625.477975:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.478034:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.478178:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801166848 00000100:00100000:0.0:1788448625.478189:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801166848 00000100:00100000:0.0:1788448625.478241:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167616 00000100:00100000:0.0:1788448625.478244:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167616 00000100:00100000:0.0:1788448625.478274:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1788448625.478307:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875323801166848:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788448625.478346:0:19479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from ce2a7bf3-0136-4a94-abb6-f1a63ca661e8@192.168.206.21@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1788448625.478395:0:19479:0:(genops.c:1385:class_connect()) connect: client ce2a7bf3-0136-4a94-abb6-f1a63ca661e8, cookie 0xf45a9e4e6b804d5f 00000004:00100000:0.0:1788448625.478429:0:19479:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788448625.478547:0:19479:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448625.478626:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2397:x1875323801166848:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 319us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.478634:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:0.0:1788448625.478653:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:0.0:1788448625.478658:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2397:x1875323801167616:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788448625.478673:0:19479:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from ce2a7bf3-0136-4a94-abb6-f1a63ca661e8@192.168.206.21@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:0.0:1788448625.478698:0:19479:0:(genops.c:1385:class_connect()) connect: client ce2a7bf3-0136-4a94-abb6-f1a63ca661e8, cookie 0xf45a9e4e6b804d66 00000004:00100000:0.0:1788448625.478711:0:19479:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788448625.478752:0:19479:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448625.478796:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2397:x1875323801167616:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 137us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.478803:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1788448625.484928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.484966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.485059:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448625.485158:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167872 00000100:00100000:0.0:1788448625.485173:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167872 00000100:00100000:0.0:1788448625.485248:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167488 00000100:00100000:0.0:1788448625.485252:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167488 00000100:00100000:0.0:1788448625.485265:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801167744 00000100:00100000:0.0:1788448625.485267:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801167744 00000100:00100000:1.0:1788448625.485403:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1788448625.485418:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+7:15033:x1875323801167872:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788448625.485460:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788448625.485551:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+7:15033:x1875323801167872:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 137us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.485560:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1788448625.485598:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1788448625.485605:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:0:x1875323801167488:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788448625.485616:0:17146:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788448625.485640:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:0:x1875323801167488:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 35us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.485646:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1788448625.485713:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1788448625.485722:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:0:x1875323801167744:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448625.485736:0:19479:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788448625.485769:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:0:x1875323801167744:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 49us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.485776:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00080000:2.0:1788448625.485838:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448625.485843:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448625.487396:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.487561:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168000 00000100:00100000:2.0:1788448625.487571:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168000 00000100:00100000:2.0:1788448625.487682:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1788448625.487692:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15033:x1875323801168000:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788448625.487779:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15033:x1875323801168000:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 91us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.487785:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448625.490313:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.490362:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.490443:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448625.490768:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168128 00000100:00100000:2.0:1788448625.490791:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168128 00000100:00100000:2.0:1788448625.490838:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168256 00000100:00100000:2.0:1788448625.490858:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168256 00000100:00100000:2.0:1788448625.490915:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:2.0:1788448625.490926:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2397:x1875323801168128:12345-192.168.206.21@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788448625.490984:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168384 00000100:00100000:0.0:1788448625.490989:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168384 00000100:00100000:0.0:1788448625.491032:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:0.0:1788448625.491040:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15033:x1875323801168384:12345-192.168.206.21@tcp:900:mount.lustre.0 00010000:00080000:2.0:1788448625.491096:0:19177:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from ce2a7bf3-0136-4a94-abb6-f1a63ca661e8@192.168.206.21@tcp t0 exp 0000000000000000 cur 542 last 0 00000020:00000080:2.0:1788448625.491144:0:19177:0:(genops.c:1385:class_connect()) connect: client ce2a7bf3-0136-4a94-abb6-f1a63ca661e8, cookie 0xf45a9e4e6b804d6d 00002000:00100000:2.0:1788448625.491160:0:19177:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ce2a7bf3-0136-4a94-abb6-f1a63ca661e8/ffff9fc083f22800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448625.491175:0:19177:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788448625.491267:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4897b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15033:x1875323801168384:12345-192.168.206.21@tcp:900:mount.lustre.0 Request processed in 227us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.491284:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00002000:00080000:2.0:1788448625.491321:0:19177:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1788448625.491323:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:0.0:1788448625.491328:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2397:x1875323801168256:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788448625.491345:0:18651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from ce2a7bf3-0136-4a94-abb6-f1a63ca661e8@192.168.206.21@tcp t0 exp 0000000000000000 cur 542 last 0 00000100:00080000:2.0:1788448625.491357:0:19177:0:(import.c:65:import_set_state_nolock()) ffff9fc083f23800 : changing import state from RECOVER to FULL 00000020:00000080:0.0:1788448625.491368:0:18651:0:(genops.c:1385:class_connect()) connect: client ce2a7bf3-0136-4a94-abb6-f1a63ca661e8, cookie 0xf45a9e4e6b804d74 00002000:00100000:0.0:1788448625.491373:0:18651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ce2a7bf3-0136-4a94-abb6-f1a63ca661e8/ffff9fc1872d4000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788448625.491380:0:18651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788448625.491389:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4895180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2397:x1875323801168128:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 464us (1115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.491396:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00002000:00080000:0.0:1788448625.491437:0:18651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788448625.491455:0:18651:0:(import.c:65:import_set_state_nolock()) ffff9fc1872d6800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448625.491478:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4894a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2397:x1875323801168256:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 149us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.491485:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:0.0:1788448625.493622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448625.493746:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168512 00000100:00100000:1.0:1788448625.493757:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168512 00000100:00100000:1.0:1788448625.493926:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:1.0:1788448625.493939:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15033:x1875323801168512:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788448625.494067:0:17149:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788448625.494178:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15033:x1875323801168512:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 241us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.494187:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:1.0:1788448625.660545:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448625.660646:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168640 00000100:00100000:3.0:1788448625.660659:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168640 00000100:00100000:3.0:1788448625.660733:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1788448625.660745:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15067:x1875323801168640:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:3.0:1788448625.660771:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448625.660800:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9400/0xf45a9e4e6b804d7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a6f expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.660921:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.660938:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.660956:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448625.661094:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788448625.661098:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788448625.661123:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.661155:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9400/0xf45a9e4e6b804d7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.661350:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.661362:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:3.0:1788448625.661365:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448625.661369:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9a00, rc 0) 00000100:00100000:3.0:1788448625.661448:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+7:15067:x1875323801168640:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 704us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.661457:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1788448625.857636:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448625.857664:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826418560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448625.857749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448625.857826:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448625.857841:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826418688:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788448625.857870:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448625.857943:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418560 00000100:00100000:1.0:1788448625.857952:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418560 00000100:00100000:1.0:1788448625.858007:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418688 00000100:00100000:1.0:1788448625.858010:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418688 00000100:00100000:1.0:1788448625.858031:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448625.858041:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826418560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448625.858107:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448625.858173:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826418560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.858181:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448625.858200:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788448625.858207:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826418688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788448625.858224:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788448625.858255:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826418688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.858261:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788448625.858316:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826418560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448625.858349:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826418688:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788448626.366116:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448626.366181:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826418816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448626.366305:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448626.366429:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418816 00000100:00100000:0.0:1788448626.366439:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418816 00000100:00100000:0.0:1788448626.366507:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448626.366519:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826418816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448626.366548:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788448626.366598:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1b4896a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826418816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448626.366611:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788448626.366775:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448626.366824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0836ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826418816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448626.367327:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826418944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448626.367381:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448626.367550:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826418944 00000100:00100000:2.0:1788448626.367557:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826418944 00000100:00100000:2.0:1788448626.367645:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448626.367656:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826418944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448626.367677:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448626.367722:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826418944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448626.367729:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448626.367766:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826418944:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788448626.367963:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448627.391782:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788448627.841182:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448627.903450:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826419072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448627.903556:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448627.903721:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419072 00000100:00100000:1.0:1788448627.903735:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419072 00000100:00100000:1.0:1788448627.903807:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448627.903820:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826419072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448627.903856:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448627.903936:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826419072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448627.903944:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448627.904155:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826419328:0@lo:400:kworker.0 00000100:00100000:3.0:1788448627.904192:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448627.904218:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826419840:0@lo:400:kworker.0 00000100:00100000:3.0:1788448627.904244:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448627.904293:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826420352:0@lo:400:kworker.0 00000100:00100000:3.0:1788448627.904321:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448627.904341:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788448627.904358:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826419200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906269:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826419456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.906422:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826419968:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906445:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.906483:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826420480:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906508:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.906539:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788448627.906546:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826419584:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.906587:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826420096:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.906623:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826420608:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.906644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788448627.906747:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448627.906810:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826419072:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448627.906875:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420352 00000100:00100000:0.0:1788448627.906920:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420352 00000100:00100000:0.0:1788448627.906975:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420480 00000100:00100000:0.0:1788448627.906978:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420480 00000100:00100000:0.0:1788448627.906994:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419584 00000100:00100000:0.0:1788448627.906996:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419584 00000100:00100000:0.0:1788448627.907007:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420096 00000100:00100000:0.0:1788448627.907009:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420096 00000100:00100000:0.0:1788448627.907021:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420608 00000100:00100000:0.0:1788448627.907023:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420608 00000100:00100000:0.0:1788448627.907067:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788448627.907077:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826420352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907143:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb424a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875323826420352:12345-0@lo:400:kworker.0 Request processed in 67us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907150:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788448627.907169:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448627.907176:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826420480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907206:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826420480:12345-0@lo:400:kworker.0 Request processed in 31us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907212:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448627.907223:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448627.907230:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826419584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907256:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875323826419584:12345-0@lo:400:kworker.0 Request processed in 27us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907262:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448627.907272:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448627.907277:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826420096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907323:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875323826420096:12345-0@lo:400:kworker.0 Request processed in 46us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907340:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448627.907351:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448627.907357:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826420608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907386:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875323826420608:12345-0@lo:400:kworker.0 Request processed in 29us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907392:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448627.907413:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419840 00000100:00100000:0.0:1788448627.907418:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419840 00000100:00100000:0.0:1788448627.907445:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419456 00000100:00100000:0.0:1788448627.907448:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419456 00000100:00100000:0.0:1788448627.907468:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419968 00000100:00100000:0.0:1788448627.907471:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419968 00000100:00100000:0.0:1788448627.907487:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448627.907493:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826419840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907527:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826419840:12345-0@lo:400:kworker.0 Request processed in 34us (3282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907533:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448627.907544:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448627.907549:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826419456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907574:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826419456:12345-0@lo:400:kworker.0 Request processed in 25us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907579:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448627.907589:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448627.907594:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826419968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.907619:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826419968:12345-0@lo:400:kworker.0 Request processed in 25us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.907634:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448627.907773:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826420480:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.907798:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875323826419584:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.907810:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875323826420096:0@lo:400:kworker.0 00010000:00080000:2.0:1788448627.907824:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb427800 x1875323826420608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448627.907835:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875323826420608:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.907845:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826419456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.907854:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4895f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826419968:0@lo:400:kworker.0 00000100:00080000:2.0:1788448627.908077:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448627.908082:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448627.908085:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448627.908274:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448627.908779:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826420736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788448627.908840:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448627.908924:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419328 00000100:00100000:1.0:1788448627.908942:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419328 00000100:00100000:1.0:1788448627.908988:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788448627.908996:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826419328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448627.909048:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826419328:12345-0@lo:400:kworker.0 Request processed in 52us (4855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448627.909055:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448627.910306:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420736 00000100:00100000:3.0:1788448627.910320:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420736 00000100:00100000:2.0:1788448627.910455:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419200 00000100:00100000:2.0:1788448627.910465:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419200 00000100:00100000:2.0:1788448627.910551:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448627.910564:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826419200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.910721:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826419200:12345-0@lo:400:kworker.0 Request processed in 92us (2385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448627.910729:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788448627.910754:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448627.910770:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826420736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448627.910797:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788448627.910824:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826419200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.910840:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826419712:0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.911056:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826420736:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448627.911145:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826420736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 179us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448627.911156:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448627.914533:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.914808:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826420224:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.914902:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448627.914959:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4896680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826419328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448627.914980:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4897800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826419840:0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.914983:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420224 00010000:00080000:2.0:1788448627.915000:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb427100 x1875323826420352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448643 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448627.915001:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420224 00000100:00100000:2.0:1788448627.915017:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875323826420352:0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.915118:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448627.915130:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826420224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448627.915228:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826420224:12345-0@lo:400:kworker.0 Request processed in 99us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448627.915237:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788448627.915246:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826420224:0@lo:400:kworker.0 00000100:00100000:1.0:1788448627.915582:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826419712 00000100:00100000:1.0:1788448627.915591:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826419712 00000100:00100000:1.0:1788448627.915794:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448627.915804:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826419712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448627.915874:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826419712:12345-0@lo:400:kworker.0 Request processed in 72us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448627.915902:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448627.916161:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1b4894700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826419712:0@lo:400:kworker.0 00000100:00080000:3.0:1788448627.918092:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448628.414370:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448628.420236:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00100000:1.0:1788448628.420251:0:18646:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000001:00100000:0.0:1788448628.420407:0:17878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00100000:0.0:1788448628.420415:0:17878:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000001:00100000:0.0:1788448628.423822:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000001:00100000:0.0:1788448628.423840:0:17125:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 03254173-b90a-4634-8f44-6b5b52d8ff13 00000001:02000400:3.0:1788448628.977832:0:20024:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788448629.438117:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448630.468925:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448630.631645:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631707:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631747:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631789:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631821:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631844:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631867:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631918:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631947:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448630.631981:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168896 00000100:00100000:0.0:1788448630.631994:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168896 00000100:00100000:0.0:1788448630.632083:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169408 00000100:00100000:0.0:1788448630.632087:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169408 00000100:00100000:0.0:1788448630.632110:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169024 00000100:00100000:0.0:1788448630.632114:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169024 00000100:00100000:0.0:1788448630.632133:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169536 00000100:00100000:0.0:1788448630.632136:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169536 00000100:00100000:0.0:1788448630.632176:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1788448630.632190:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2400:x1875323801168896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.632691:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:2.0:1788448630.632724:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801169408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448630.632813:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2400:x1875323801168896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 625us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448630.632821:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1788448630.632846:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:0.0:1788448630.632854:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801169024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788448630.632950:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169152 00000100:00100000:1.0:1788448630.632957:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169152 00000100:00100000:1.0:1788448630.633001:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169664 00000100:00100000:1.0:1788448630.633004:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169664 00000100:00100000:1.0:1788448630.633026:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169280 00000100:00100000:1.0:1788448630.633030:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169280 00000100:00100000:1.0:1788448630.633050:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169792 00000100:00100000:1.0:1788448630.633053:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169792 00000100:00100000:1.0:1788448630.633074:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448630.633083:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801169152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.636601:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801169408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3884us (4836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448630.636621:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:2.0:1788448630.636671:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1788448630.636716:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801169536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.636791:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801169536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 102us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448630.636798:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:2.0:1788448630.636835:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1788448630.636848:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801169664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.636877:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801169664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448630.636901:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1788448630.636917:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1788448630.636926:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801169280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.636950:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801169280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (5082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448630.636956:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:2.0:1788448630.636979:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1788448630.636988:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801169792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.637013:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801169792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (5065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448630.637019:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00080000:2.0:1788448630.638191:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448630.638202:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448630.638207:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788448630.638212:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448630.638246:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801168768 00000100:00100000:2.0:1788448630.638276:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801168768 00000100:00100000:2.0:1788448630.638352:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:2.0:1788448630.638360:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801168768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788448630.638424:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082280c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2400:x1875323801168768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (6601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448630.638432:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 145 00000100:00100000:0.0:1788448630.642170:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801169024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 9289us (10296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448630.642191:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:1.0:1788448630.642748:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801169152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 9663us (11036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448630.642772:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:1.0:1788448630.977805:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448630.977838:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826420864:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448630.977961:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448630.979499:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448630.979523:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826420992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448630.979775:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420864 00000100:00100000:3.0:1788448630.979785:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420864 00000100:00100000:3.0:1788448630.979859:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448630.979871:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826420864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448630.979946:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448630.980549:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826420864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 677us (2586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448630.980559:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448630.980591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448630.980789:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826420864:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448630.982950:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826420992 00000100:00100000:2.0:1788448630.983102:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826420992 00000100:00100000:0.0:1788448630.985039:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788448630.985073:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826420992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788448630.985136:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788448630.985291:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb426680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826420992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 235us (4699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448630.985300:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448630.985404:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826420992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788448631.486526:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826421120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448631.486605:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448631.486677:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826421248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448631.486703:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448631.486748:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421120 00000100:00100000:2.0:1788448631.486756:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421120 00000100:00100000:2.0:1788448631.487165:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421248 00000100:00100000:2.0:1788448631.487170:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421248 00000100:00100000:2.0:1788448631.487204:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448631.487213:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826421120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448631.487240:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448631.487298:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826421120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448631.487305:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448631.487321:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448631.487331:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826421248:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448631.487340:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448631.487382:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826421248:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448631.487388:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788448631.487409:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448631.487443:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826421248:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788448631.487591:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826421120:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788448631.499007:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448631.504730:0:19465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ce2a7bf3-0136-4a94-abb6-f1a63ca661e8 00000040:00080000:1.0:1788448632.000460:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788448632.510377:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448633.022111:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826421760:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022197:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022250:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826422272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022321:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826422784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022348:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022388:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788448633.022401:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826421376:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022431:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022456:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826421888:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022477:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022495:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826422400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022515:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022533:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826422912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022554:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022581:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826421504:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022610:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022630:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826422016:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022845:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826422528:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022906:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022922:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788448633.022929:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826421632:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.022953:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.022973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826422144:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.023001:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.023019:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826422656:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.023038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448633.023065:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421760 00000100:00100000:3.0:1788448633.023073:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421760 00000100:00100000:3.0:1788448633.023123:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422272 00000100:00100000:3.0:1788448633.023127:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422272 00000100:00100000:3.0:1788448633.023141:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421632 00000100:00100000:3.0:1788448633.023143:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421632 00000100:00100000:3.0:1788448633.023153:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422144 00000100:00100000:3.0:1788448633.023155:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422144 00000100:00100000:3.0:1788448633.023183:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448633.023191:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826421760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.023244:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb425880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826421760:12345-0@lo:400:kworker.0 Request processed in 53us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.023260:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448633.023277:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448633.023283:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826422272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.023310:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875323826422272:12345-0@lo:400:kworker.0 Request processed in 28us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.023315:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448633.023326:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448633.023331:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826421632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.023359:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826421632:12345-0@lo:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448633.023843:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448633.023854:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826423040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448633.023905:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448633.023949:0:19888:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826423040 00000100:00100000:0.0:1788448633.023953:0:19888:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826423040 00000100:00100000:0.0:1788448633.023987:0:19888:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448633.023994:0:19888:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826423040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448633.024017:0:19888:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448633.024056:0:19888:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875323826423040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448633.024062:0:19888:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448633.024108:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875323826423040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448633.024752:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826423168:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788448633.024784:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448633.025496:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826423168 00000100:00100000:2.0:1788448633.025505:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826423168 00000100:00100000:2.0:1788448633.025574:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788448633.025587:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826423168:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788448633.025608:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788448633.025676:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826423168:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448633.025683:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788448633.025729:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826423168:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448633.026488:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448633.026515:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448633.026544:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826422144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.026615:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826422144:12345-0@lo:400:kworker.0 Request processed in 77us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.026621:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448633.026657:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422784 00000100:00100000:1.0:1788448633.027514:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421504 00000100:00100000:1.0:1788448633.027523:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421504 00000100:00100000:1.0:1788448633.027557:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422016 00000100:00100000:1.0:1788448633.027561:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422016 00000100:00100000:1.0:1788448633.027576:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448633.027583:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826421504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448633.027640:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826421504:12345-0@lo:400:kworker.0 Request processed in 58us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448633.027646:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448633.027741:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422784 00000100:00100000:3.0:1788448633.027768:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421888 00000100:00100000:3.0:1788448633.027771:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421888 00000100:00100000:3.0:1788448633.027782:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422400 00000100:00100000:3.0:1788448633.027785:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422400 00000100:00100000:3.0:1788448633.027794:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422912 00000100:00100000:3.0:1788448633.027797:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422912 00000100:00100000:3.0:1788448633.027809:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422528 00000100:00100000:3.0:1788448633.027812:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422528 00000100:00100000:3.0:1788448633.027823:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826422656 00000100:00100000:3.0:1788448633.027826:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826422656 00000100:00100000:3.0:1788448633.027840:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448633.027845:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826422784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.027915:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875323826422784:12345-0@lo:400:kworker.0 Request processed in 70us (5566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.027921:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448633.027933:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448633.027939:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826421888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.027965:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875323826421888:12345-0@lo:400:kworker.0 Request processed in 26us (5487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.027970:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448633.027981:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448633.027986:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826422400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.028029:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875323826422400:12345-0@lo:400:kworker.0 Request processed in 43us (5514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.028034:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448633.028046:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448633.028051:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826422912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.028074:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875323826422912:12345-0@lo:400:kworker.0 Request processed in 23us (5519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.028079:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448633.028088:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448633.028094:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826422528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.028117:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875323826422528:12345-0@lo:400:kworker.0 Request processed in 24us (5235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.028123:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448633.028133:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448633.028139:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826422656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.028164:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826422656:12345-0@lo:400:kworker.0 Request processed in 26us (5125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.028170:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448633.028191:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448633.028198:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826422016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.028225:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826422016:12345-0@lo:400:kworker.0 Request processed in 28us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.028230:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788448633.028268:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448633.028272:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448633.028281:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448633.028284:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448633.028327:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826421632:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.028341:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826422144:0@lo:400:kworker.0 00010000:00080000:3.0:1788448633.028354:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb427100 x1875323826422656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448633.028378:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826422656:0@lo:400:kworker.0 00000100:00100000:1.0:1788448633.028587:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826421376 00000100:00100000:1.0:1788448633.028595:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826421376 00000100:00100000:1.0:1788448633.028633:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788448633.028639:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826421376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448633.029224:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3647:x1875323826421376:12345-0@lo:400:kworker.0 Request processed in 583us (6790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448633.029233:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788448633.029966:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:943bfcb5-816e-4cdd-a66b-4e69884ef502:3647:1875323826421376:0@lo:400:kworker.0 00000100:00100000:2.0:1788448633.029988:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875323826421888:0@lo:400:kworker.0 00000100:00100000:2.0:1788448633.030000:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb426a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875323826422400:0@lo:400:kworker.0 00010000:00080000:2.0:1788448633.030015:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc1bb424000 x1875323826422912/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448633.030026:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875323826422912:0@lo:400:kworker.0 00000100:00100000:2.0:1788448633.030039:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826421760:0@lo:400:kworker.0 00000100:00100000:2.0:1788448633.030050:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875323826422272:0@lo:400:kworker.0 00000100:00100000:2.0:1788448633.030076:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875323826422784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.030954:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb424e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826421504:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.030983:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb425f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826422016:0@lo:400:kworker.0 00000100:00100000:3.0:1788448633.030996:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bb427480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875323826422528:0@lo:400:kworker.0 00000020:00000080:3.0:1788448633.381010:0:20172:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff911cbc00 20000000:00000080:3.0:1788448633.381028:0:20172:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9fc1b66a2800 uarg=0000000000000000 20000000:01000000:3.0:1788448633.381067:0:20172:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788448633.381072:0:20172:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788448633.381076:0:20172:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788448633.381623:0:20173:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788448633.382061:0:20172:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788448633.394695:0:20172:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788448633.395607:0:20172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395626:0:20172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395634:0:20172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395641:0:20172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395647:0:20172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395655:0:20172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395680:0:20172:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395688:0:20172:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395730:0:20172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 12 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395743:0:20172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 12 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.395757:0:20172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423296:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448633.395863:0:20172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395871:0:20172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 12 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.395900:0:20172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423424:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448633.395934:0:20172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.395942:0:20172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 23 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.395950:0:20172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423552:0@lo:104: 00000100:00100000:0.0:1788448633.395987:0:20172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448633.396050:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826423552 00010000:00010000:0.0:1788448633.396051:0:20172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 23 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448633.396059:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826423552 00010000:00010000:0.0:1788448633.396063:0:20172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 23 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.396074:0:20172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423680:0@lo:104: 00000100:00100000:0.0:1788448633.396112:0:20172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448633.396127:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826423680 00000100:00100000:2.0:1788448633.396131:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826423680 00010000:00010000:0.0:1788448633.396149:0:20172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448633.396153:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788448633.396165:0:20172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 23 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448633.396169:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:20172:x1875323826423552:12345-0@lo:104: 00000100:00100000:0.0:1788448633.396179:0:20172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423808:0@lo:104: 00010000:00010000:2.0:1788448633.396184:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.396203:0:20172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448633.396224:0:20172:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 23 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.396233:0:20172:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 23 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.396242:0:20172:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423936:0@lo:104: 00010000:00010000:2.0:1788448633.396266:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448633.396273:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:20172:x1875323826423552:12345-0@lo:104: Request processed in 109us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448633.396281:0:20172:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448633.396285:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448633.396295:0:20172:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824200c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448633.396303:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826423808 00000100:00100000:2.0:1788448633.396307:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826423808 00000100:00100000:0.0:1788448633.396318:0:20172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423552:0@lo:104: 00000100:00100000:2.0:1788448633.396327:0:17128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826423936 00000100:00100000:2.0:1788448633.396331:0:17128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826423936 00000100:00100000:2.0:1788448633.396343:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448633.396350:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+5:20172:x1875323826423680:12345-0@lo:104: 00010000:00010000:2.0:1788448633.396358:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448633.396402:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788448633.396407:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+5:20172:x1875323826423680:12345-0@lo:104: Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448633.396413:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448633.396433:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448633.396450:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:20172:x1875323826423808:12345-0@lo:104: 00010000:00010000:2.0:1788448633.396458:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448633.396551:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788448633.396558:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+4:20172:x1875323826423808:12345-0@lo:104: Request processed in 112us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448633.396566:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448633.396579:0:20172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eaa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423680:0@lo:104: 00000100:00100000:2.0:1788448633.396584:0:17128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788448633.396594:0:20172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423808:0@lo:104: 00000100:00100000:2.0:1788448633.396598:0:17128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:20172:x1875323826423936:12345-0@lo:104: 00010000:00010000:2.0:1788448633.396607:0:17128:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.396911:0:20172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eab480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423936:0@lo:104: 00010000:00010000:3.0:1788448633.404545:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788448633.404561:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448633.404574:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc08351e600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:3.0:1788448633.404580:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448633.404592:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448633.404619:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448633.404626:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448633.405325:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405337:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448633.405362:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405370:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc08351e600/0xf45a9e4e6b804bc2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804bc9 expref: -99 pid: 19464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405387:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788448633.405403:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405410:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fda00 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448633.405413:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405421:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448633.405428:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448633.405432:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448633.405448:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405455:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448633.405460:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405478:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc0824fda00/0xf45a9e4e6b804a64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a6b expref: -99 pid: 18645 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405487:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448633.405490:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405495:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448633.405498:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405505:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448633.405511:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448633.405516:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448633.405528:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405533:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448633.405546:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405552:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc0824fd600/0xf45a9e4e6b804a25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a2c expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405560:0:19726:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448633.405569:0:19726:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405574:0:19726:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc18152f600 already unused, calling callback (ffffffffc1169c20) 10000000:00010000:0.0:1788448633.405577:0:19726:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405584:0:19726:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448633.405589:0:19726:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448633.405594:0:19726:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448633.405606:0:19726:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405611:0:19726:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448633.405615:0:19726:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405620:0:19726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9fc18152f600/0xf45a9e4e6b804a17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf45a9e4e6b804a1e expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.405632:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448633.405634:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448633.405636:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448633.405655:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826424192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448633.405717:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448633.405766:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448633.405772:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826424064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448633.405801:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826424320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448633.405829:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448633.405928:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424192 00000100:00100000:1.0:1788448633.405942:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424192 00010000:00010000:1.0:1788448633.405976:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 24 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448633.406005:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424064 00000100:00100000:1.0:1788448633.406010:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424064 00010000:00010000:1.0:1788448633.406021:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 25 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448633.406034:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448633.406041:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+25:3648:x1875323826424192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448633.406053:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448633.406057:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 25 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.406066:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 25 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.406079:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc182c1fc00/0xf45a9e4e6b804a6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b804a64 expref: 25 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.406092:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448633.406466:0:17128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788448633.406477:0:17128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+3:20172:x1875323826423936:12345-0@lo:104: Request processed in 9884us (10198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448633.406486:0:17128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788448633.406526:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448633.406532:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448633.406546:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc183eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826424448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448633.407318:0:17132:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788448633.407328:0:17132:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788448633.407385:0:17130:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788448633.408248:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448633.408277:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826424064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448633.408295:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448633.408305:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 24 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.408320:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 24 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.408337:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc18152fa00/0xf45a9e4e6b804bc9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b804bc2 expref: 24 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.408353:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448633.408441:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:3648:x1875323826424064:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448633.408449:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448633.408508:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826424064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448633.409624:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448633.411258:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3648:x1875323826424192:12345-0@lo:103:ldlm_bl.0 Request processed in 5196us (5519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448633.411273:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448633.411327:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448633.411366:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448633.411368:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826424192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448633.411405:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801169920 00000100:00100000:0.0:1788448633.411414:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801169920 00010000:00010000:0.0:1788448633.411451:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 13 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.411506:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170048 00000100:00100000:0.0:1788448633.411510:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170048 00010000:00010000:0.0:1788448633.411525:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 14 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448633.411533:0:20174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1788448633.411546:0:20174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712f63d1-2d07-4fc2-9551-3a10ea985aa1+14:2399:x1875323801169920:12345-192.168.206.21@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788448633.411564:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1788448633.411574:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+14:2399:x1875323801170048:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448633.411585:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448633.411591:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 14 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.411602:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 14 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.411621:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448633.411669:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+14:2399:x1875323801170048:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 96us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448633.411705:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448633.412182:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448633.412280:0:17131:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788448633.412294:0:17131:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:1.0:1788448633.412308:0:20174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448633.412315:0:20174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 14 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.412326:0:20174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 14 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.412338:0:20174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448633.412359:0:20174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:712f63d1-2d07-4fc2-9551-3a10ea985aa1+14:2399:x1875323801169920:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 817us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448633.412367:0:20174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:1.0:1788448633.412381:0:20174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424320 00000100:00100000:1.0:1788448633.412384:0:20174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424320 00010000:00010000:1.0:1788448633.412398:0:20174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 22 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448633.412408:0:20174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424448 00000100:00100000:1.0:1788448633.412410:0:20174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424448 00010000:00010000:1.0:1788448633.412646:0:20174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 23 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448633.412661:0:20174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448633.412667:0:20174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0837bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:3645:x1875323826424320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448633.412675:0:20174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448633.412678:0:20174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 23 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.412807:0:20174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 23 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.412828:0:20174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc08351f200/0xf45a9e4e6b804a2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b804a25 expref: 23 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.412839:0:20174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448633.412953:0:20174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0837bf850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:3645:x1875323826424320:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448633.412959:0:20174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448633.412973:0:20174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448633.412979:0:20174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:3646:x1875323826424448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448633.412987:0:20174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448633.412991:0:20174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 21 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413000:0:20174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 21 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413009:0:20174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc0824fd400/0xf45a9e4e6b804a1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf45a9e4e6b804a17 expref: 21 pid: 17140 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413018:0:20174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413026:0:20174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413038:0:20174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413044:0:20174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413057:0:20174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413064:0:20174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413069:0:20174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448633.413073:0:20174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413081:0:20174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413090:0:20174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448633.413100:0:20174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448633.413124:0:20174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:3646:x1875323826424448:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448633.413131:0:20174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448633.413191:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:943bfcb5-816e-4cdd-a66b-4e69884ef502:3646:1875323826424448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448633.413552:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00010000:00010000:0.0:1788448633.413744:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804d58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a3e expref: 12 pid: 17139 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.413756:0:20172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eabb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423296:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448633.413768:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ce expref: 11 pid: 17138 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448633.413777:0:20172:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183ea9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20172:1875323826423424:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448633.413801:0:20172:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.413817:0:20172:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.413824:0:20172:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448633.413829:0:20172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804d89 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448633.419157:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc183eaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826424320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448633.536748:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448634.536284:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448634.538838:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170176 00000100:00100000:0.0:1788448634.538855:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170176 00000100:00100000:0.0:1788448634.538974:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00100000:0.0:1788448634.538986:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+11:14915:x1875323801170176:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448634.539002:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448634.539021:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a76 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448634.539049:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a76 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448634.539059:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204b200/0xf45a9e4e6b804d90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a76 expref: 12 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448634.539069:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b200, rc 0) 00000100:00100000:0.0:1788448634.539141:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:14915:x1875323801170176:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 157us (2863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448634.539148:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 147 00000100:00100000:0.0:1788448634.547553:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448634.547662:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170304 00000100:00100000:2.0:1788448634.547673:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170304 00000100:00100000:2.0:1788448634.547744:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 148 00000100:00100000:2.0:1788448634.547756:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:14915:x1875323801170304:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448634.548208:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:14915:x1875323801170304:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 454us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448634.548217:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 148 00000100:00100000:1.0:1788448634.558398:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788448634.559170:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448634.562258:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170432 00000100:00100000:0.0:1788448634.562272:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170432 00000100:00100000:0.0:1788448634.562381:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:0.0:1788448634.562391:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:14915:x1875323801170432:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448634.562535:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:14915:x1875323801170432:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 145us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448634.562543:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 149 00000100:00100000:3.0:1788448634.570345:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448634.574449:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170560 00000100:00100000:2.0:1788448634.574466:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170560 00000100:00100000:2.0:1788448634.574538:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:2.0:1788448634.574550:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+12:14915:x1875323801170560:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448634.574566:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448634.574585:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804d97 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a7d expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448634.574614:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a7d expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448634.574625:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1a0331c00/0xf45a9e4e6b804d97 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a7d expref: 13 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448634.574634:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1a0331c00, rc 0) 00000100:00100000:2.0:1788448634.574701:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:14915:x1875323801170560:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 154us (4366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448634.574709:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 150 00000100:00100000:1.0:1788448634.582342:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448634.582725:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170688 00000100:00100000:0.0:1788448634.582736:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170688 00000100:00100000:0.0:1788448634.582791:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 151 00000100:00100000:0.0:1788448634.582802:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:14915:x1875323801170688:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448634.582986:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:14915:x1875323801170688:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 186us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448634.582994:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 151 00000100:00100000:1.0:1788448634.589525:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448634.592228:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170816 00000100:00100000:0.0:1788448634.592254:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170816 00000100:00100000:1.0:1788448634.593625:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 152 00000100:00100000:1.0:1788448634.593640:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:14915:x1875323801170816:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448634.593792:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:14915:x1875323801170816:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 156us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448634.593813:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 152 10000000:01000000:2.0:1788448635.262032:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448635.262040:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc1bb4c1000 from 13 10000000:01000000:2.0:1788448635.262045:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448635.262107:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.262139:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.262151:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.262177:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.262267:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.262559:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448635.262797:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424576 00000100:00100000:3.0:1788448635.262805:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424576 00000100:00100000:3.0:1788448635.262863:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788448635.262873:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+20:17142:x1875323826424576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448635.262921:0:17140:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448635.263165:0:17140:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b804da5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804d9e expref: -99 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.263193:0:17140:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b804da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804d9e expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.263204:0:17140:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1bb4a9e00/0xf45a9e4e6b804da5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804d9e expref: 21 pid: 17140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.263224:0:17140:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1bb4a9e00, rc 0) 00000100:00100000:3.0:1788448635.263458:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826424576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 585us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.263466:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788448635.263557:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448635.263574:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.263583:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.263669:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.263701:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.263777:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448635.264148:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424704 00000100:00100000:1.0:1788448635.264154:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424704 00000100:00100000:1.0:1788448635.264365:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788448635.264375:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826424704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448635.264507:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826424704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 134us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448635.264514:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788448635.264588:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.264623:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.264668:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.265293:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448635.265506:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424832 00000100:00100000:0.0:1788448635.265513:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424832 00000100:00100000:0.0:1788448635.265549:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788448635.265557:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826424832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448635.265666:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826424832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448635.265674:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788448635.265826:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788448635.266983:0:20242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788448635.267064:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788448635.267086:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448635.267097:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.267108:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1a0330c00/0xf45a9e4e6b804d9e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804da5 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448635.267119:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448635.267122:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc183e97800 from 13 10000000:01000000:2.0:1788448635.267125:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448635.267168:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.267175:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.267185:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.267206:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.267274:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.267486:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448635.267628:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826424960 00000100:00100000:0.0:1788448635.267635:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826424960 00000100:00100000:0.0:1788448635.267675:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788448635.267683:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+21:17142:x1875323826424960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448635.267694:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448635.267707:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804db3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804dac expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.267731:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804dac expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.267743:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204be00/0xf45a9e4e6b804db3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804dac expref: 22 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.267751:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204be00, rc 0) 00000100:00100000:0.0:1788448635.267804:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826424960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448635.267811:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788448635.267932:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826424960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448635.267957:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.267968:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.268040:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.268067:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.268078:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448635.268196:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425088 00000100:00100000:0.0:1788448635.268201:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425088 00000100:00100000:0.0:1788448635.268230:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448635.268236:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826425088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448635.268483:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826425088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448635.268491:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788448635.268660:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.268688:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.268727:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.268756:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908600c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448635.268802:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425216 00000100:00100000:0.0:1788448635.268806:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425216 00000100:00100000:0.0:1788448635.268838:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788448635.268845:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826425216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448635.268956:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826425216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448635.268969:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788448635.269151:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788448635.270410:0:20243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788448635.272687:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788448635.272736:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448635.272748:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.272760:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5600/0xf45a9e4e6b804dac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804db3 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448635.272772:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448635.272775:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc187ba7000 from 13 10000000:01000000:2.0:1788448635.272778:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448635.272816:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.272825:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.272836:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.272877:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.272986:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.273029:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc190860c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448635.273635:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425344 00000100:00100000:1.0:1788448635.273643:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425344 00000100:00100000:1.0:1788448635.273698:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788448635.273709:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+22:17142:x1875323826425344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448635.273722:0:17139:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448635.273735:0:17139:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc0824fd600/0xf45a9e4e6b804dc1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804dba expref: -99 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448635.273760:0:17139:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc0824fd600/0xf45a9e4e6b804dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804dba expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448635.273771:0:17139:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc0824fd600/0xf45a9e4e6b804dc1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804dba expref: 23 pid: 17139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448635.273779:0:17139:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd600, rc 0) 00000100:00100000:1.0:1788448635.273825:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826425344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448635.273830:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788448635.273900:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448635.273915:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448635.273923:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448635.273994:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448635.274022:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448635.274037:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc184cc3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448635.274096:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425472 00000100:00100000:3.0:1788448635.274102:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425472 00000100:00100000:3.0:1788448635.274278:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788448635.274295:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826425472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448635.274400:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826425472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.274407:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788448635.274438:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448635.274469:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448635.274508:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448635.274527:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448635.274538:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425600 00000100:00100000:3.0:1788448635.274541:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425600 00000100:00100000:3.0:1788448635.274560:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788448635.274565:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826425600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448635.274635:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826425600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.274642:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788448635.274678:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788448635.280170:0:20244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788448635.280586:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788448635.280612:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448635.280625:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.280639:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1871e5800/0xf45a9e4e6b804dba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dc1 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448635.280665:0:17142:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448635.280668:0:17142:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9fc083f6b800 from 13 10000000:01000000:3.0:1788448635.280671:0:17142:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448635.280708:0:17142:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.280716:0:17142:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.280726:0:17142:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448635.280751:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448635.280822:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448635.280873:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448635.282734:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425728 00000100:00100000:0.0:1788448635.282746:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425728 00000100:00100000:0.0:1788448635.282807:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788448635.282819:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+23:17142:x1875323826425728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448635.282834:0:17138:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448635.282850:0:17138:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804dcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf45a9e4e6b804dc8 expref: -99 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.282876:0:17138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf45a9e4e6b804dc8 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.282908:0:17138:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9fc1c204b000/0xf45a9e4e6b804dcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf45a9e4e6b804dc8 expref: 24 pid: 17138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.282916:0:17138:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b000, rc 0) 00000100:00100000:0.0:1788448635.282987:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826425728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (2165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448635.282994:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788448635.283047:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff04e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448635.283064:0:17142:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.283074:0:17142:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448635.283423:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448635.283471:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448635.283509:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448635.283672:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425856 00000100:00100000:2.0:1788448635.283678:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425856 00000100:00100000:2.0:1788448635.283724:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788448635.283733:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826425856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448635.283856:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826425856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448635.283864:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788448635.283979:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448635.284009:0:17142:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448635.284050:0:17142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448635.284072:0:17142:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448635.284149:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826425984 00000100:00100000:3.0:1788448635.284154:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826425984 00000100:00100000:3.0:1788448635.284188:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788448635.284195:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826425984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448635.284474:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187f30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:17142:x1875323826425984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.284481:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788448635.284607:0:17142:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:943bfcb5-816e-4cdd-a66b-4e69884ef502:17142:1875323826425984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788448635.285645:0:20245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788448635.285829:0:17142:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788448635.285857:0:17142:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448635.285866:0:17142:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.285877:0:17142:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9fc1bb4a9400/0xf45a9e4e6b804dc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf45a9e4e6b804dcf expref: -99 pid: 17142 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448635.583226:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448635.755266:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755307:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755337:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755356:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755379:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755397:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755414:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755430:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448635.755449:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448635.755640:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171072 00000100:00100000:3.0:1788448635.755651:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171072 00000100:00100000:3.0:1788448635.755709:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171584 00000100:00100000:3.0:1788448635.755713:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171584 00000100:00100000:3.0:1788448635.755728:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171200 00000100:00100000:3.0:1788448635.755741:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171200 00000100:00100000:3.0:1788448635.755757:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171712 00000100:00100000:3.0:1788448635.755759:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171712 00000100:00100000:3.0:1788448635.755774:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1788448635.755784:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2401:x1875323801171072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.755856:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2401:x1875323801171072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.755864:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1788448635.755905:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:3.0:1788448635.755913:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2401:x1875323801171584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.755950:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2401:x1875323801171584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.755957:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:3.0:1788448635.755969:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:3.0:1788448635.755976:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801171200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.755999:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801171200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756005:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:3.0:1788448635.756017:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:3.0:1788448635.756023:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801171712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.756045:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801171712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756051:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:3.0:1788448635.756069:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171328 00000100:00100000:3.0:1788448635.756078:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171328 00000100:00100000:3.0:1788448635.756103:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171840 00000100:00100000:3.0:1788448635.756106:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171840 00000100:00100000:3.0:1788448635.756131:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171456 00000100:00100000:3.0:1788448635.756134:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171456 00000100:00100000:3.0:1788448635.756143:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801171968 00000100:00100000:3.0:1788448635.756145:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801171968 00000100:00100000:3.0:1788448635.756156:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448635.756161:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801171328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.756202:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187723450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801171328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756392:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448635.756541:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448635.756548:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801171840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.756574:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801171840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (1217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756580:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788448635.756591:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1788448635.756598:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801171456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.756621:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801171456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (1206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756626:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1788448635.756635:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1788448635.756642:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801171968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.756660:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801171968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 19us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756673:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1788448635.756695:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801170944 00000100:00100000:3.0:1788448635.756699:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801170944 00000100:00100000:3.0:1788448635.756727:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00100000:3.0:1788448635.756733:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2401:x1875323801170944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448635.756754:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2401:x1875323801170944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.756760:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 165 00000100:00080000:0.0:1788448635.756894:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448635.756900:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448635.756908:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788448635.756911:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448636.094024:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448636.094047:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826426112:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448636.094126:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448636.094180:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826426112 00000100:00100000:1.0:1788448636.094187:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826426112 00000100:00100000:1.0:1788448636.094248:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788448636.094259:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826426112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788448636.094301:0:17151:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788448636.094350:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826426112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448636.094357:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788448636.094395:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826426112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788448636.096267:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826426240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448636.096334:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448636.097733:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826426240 00000100:00100000:3.0:1788448636.097747:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826426240 00000100:00100000:3.0:1788448636.097802:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448636.097813:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826426240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448636.097857:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788448636.098043:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826426240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 230us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448636.098051:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448636.098110:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826426240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788448636.606270:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826426368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448636.606334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448636.606374:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448636.606381:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826426496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448636.606404:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448636.606479:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826426368 00000100:00100000:2.0:1788448636.606487:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826426368 00000100:00100000:2.0:1788448636.606545:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826426496 00000100:00100000:2.0:1788448636.606548:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826426496 00000100:00100000:2.0:1788448636.606584:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448636.606594:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826426368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448636.606623:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448636.606668:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826426368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448636.606675:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448636.606691:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448636.606700:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826426496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788448636.606710:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788448636.606732:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826426496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448636.606753:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788448636.606857:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448636.606918:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826426496:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788448636.606946:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826426368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448636.610337:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448637.056272:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788448637.631281:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448637.748934:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448637.749050:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172096 00000100:00100000:2.0:1788448637.749067:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172096 00000100:00100000:2.0:1788448637.749166:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:2.0:1788448637.749195:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+6:15584:x1875323801172096:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448637.749215:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448637.749246:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b804dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a84 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749313:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749328:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749342:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749365:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749373:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749379:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749460:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4e00/0xf45a9e4e6b804deb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749496:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4e00/0xf45a9e4e6b804deb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749503:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4e00/0xf45a9e4e6b804deb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448637.749533:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448637.749537:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448637.749579:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4e00/0xf45a9e4e6b804deb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749589:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749595:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749601:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749606:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448637.749610:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749617:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749627:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:2.0:1788448637.749630:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448637.749635:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749651:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749665:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749670:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749675:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749679:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448637.749682:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749687:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749694:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9fc1bb7b4000) 00010000:00010000:2.0:1788448637.749696:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448637.749698:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749703:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b804de4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749733:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b804dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a84 expref: 8 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749758:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4e00/0xf45a9e4e6b804deb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a84 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.749765:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc1bb7b4500) 00010000:00010000:2.0:1788448637.749768:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448637.749770:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4e00, rc 0) 00000100:00100000:2.0:1788448637.749841:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+7:15584:x1875323801172096:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 665us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448637.749849:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00080000:3.0:1788448637.751818:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448637.752780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448637.752864:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172224 00000100:00100000:2.0:1788448637.752874:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172224 00000100:00100000:2.0:1788448637.752964:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:2.0:1788448637.752977:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:15584:x1875323801172224:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788448637.753059:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:15584:x1875323801172224:12345-192.168.206.21@tcp:900:lhsmtool_posix.0 Request processed in 85us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448637.753067:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:0.0:1788448637.757728:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448637.757826:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172480 00000100:00100000:1.0:1788448637.757836:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172480 00000100:00100000:1.0:1788448637.757934:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:1.0:1788448637.757945:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+7:15584:x1875323801172480:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448637.757964:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448637.758002:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804df2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a8b expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758078:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758092:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758103:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758164:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758172:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758178:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758293:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804e07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758302:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804e07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758310:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804e07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448637.758318:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788448637.758472:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758500:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758505:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758510:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448637.758514:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758522:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758535:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9fc1bb7b4500) 00010000:00010000:1.0:1788448637.758538:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.758543:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758548:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804df9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758702:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758709:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758715:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758721:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448637.758730:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758736:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758745:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9fc08319bf00) 00010000:00010000:1.0:1788448637.758748:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.758750:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.758755:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e00 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.759925:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804df2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a8b expref: 10 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.759948:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fde00/0xf45a9e4e6b804e07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a8b expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.759957:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08319b700) 00010000:00010000:1.0:1788448637.759959:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.759962:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fde00, rc 0) 00000100:00100000:1.0:1788448637.760072:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15584:x1875323801172480:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 2127us (2353us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788448637.760082:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:3.0:1788448637.777859:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448637.778703:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172608 00000100:00100000:2.0:1788448637.778713:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172608 00000100:00100000:2.0:1788448637.778783:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:2.0:1788448637.778793:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15584:x1875323801172608:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788448637.778913:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15584:x1875323801172608:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 121us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448637.778920:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:1.0:1788448637.780829:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448637.781213:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172736 00000100:00100000:2.0:1788448637.781753:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172736 00000100:00100000:2.0:1788448637.781821:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1788448637.781846:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+5:15584:x1875323801172736:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 00000100:00080000:3.0:1788448637.783765:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788448637.801976:0:19479:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 20063us 00000100:00100000:3.0:1788448637.826770:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448637.826860:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172864 00000100:00100000:1.0:1788448637.826915:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172864 00000100:00100000:1.0:1788448637.826975:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1788448637.826987:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15590:x1875323801172864:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448637.827009:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448637.827030:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a92 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827096:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827111:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827122:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827137:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827143:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827148:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827193:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827200:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827206:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827218:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448637.827223:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827242:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827255:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:1.0:1788448637.827258:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.827262:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827268:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827281:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827287:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827293:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827297:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fca00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448637.827300:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827306:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827324:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc08319bf00) 00010000:00010000:1.0:1788448637.827342:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.827346:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827632:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827672:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e15 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a92 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827683:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:1.0:1788448637.827685:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.827688:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a92 expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.827696:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd800, rc 0) 00000100:00100000:1.0:1788448637.827762:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15590:x1875323801172864:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 776us (1002us total) trans 0 rc 301/301 00000100:00100000:1.0:1788448637.827769:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1788448637.830822:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448637.839706:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801172992 00000100:00100000:1.0:1788448637.839724:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801172992 00000100:00100000:1.0:1788448637.839790:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448637.839801:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15590:x1875323801172992:12345-192.168.206.21@tcp:700:lfs.0 00000100:00100000:1.0:1788448637.839918:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15590:x1875323801172992:12345-192.168.206.21@tcp:700:lfs.0 Request processed in 118us (9108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448637.839953:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448637.843503:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+5:15584:x1875323801172736:12345-192.168.206.21@tcp:59:lhsmtool_posix.0 Request processed in 61662us (62671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448637.843518:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1788448637.845992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448637.846083:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801173248 00000100:00100000:0.0:1788448637.846093:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801173248 00000100:00100000:0.0:1788448637.846163:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1788448637.846174:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+9:15590:x1875323801173248:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:0.0:1788448637.846240:0:17146:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448637.846269:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804d43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e09ff expref: 9 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.846288:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:0.0:1788448637.846293:0:17146:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448637.846372:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.846386:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.846394:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.846426:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 5 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.846459:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 5 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448637.846475:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826426624:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448637.846561:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc08257fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448637.850015:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448637.850070:0:20174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801173376 00000100:00100000:0.0:1788448637.850080:0:20174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801173376 00010000:00010000:0.0:1788448637.850139:0:20174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 6 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448637.850174:0:20174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:0.0:1788448637.850183:0:20174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2398:x1875323801173376:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448637.850196:0:20174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448637.850203:0:20174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 6 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.850216:0:20174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 6 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.850247:0:20174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:0.0:1788448637.850252:0:20174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.850261:0:20174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.850283:0:20174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.850302:0:20174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448637.850348:0:20174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2398:x1875323801173376:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 166us (343us total) trans 0 rc 0/0 00010000:00010000:2.0:1788448637.850566:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9a00/0xf45a9e4e6b804d82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a6f expref: 6 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448637.850583:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826426624:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788448637.850603:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.850611:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.850617:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.850637:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.850647:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.850655:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788448637.851028:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448637.852544:0:20174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00010000:00010000:2.0:1788448637.854638:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854666:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854688:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448637.854709:0:17146:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045313d0f reply state 00000000c91de98c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854722:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854731:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:2.0:1788448637.854734:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448637.854739:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788448637.854746:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788448637.854755:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854761:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854768:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854774:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448637.854780:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854787:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854799:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc1bb7b4800) 00010000:00010000:2.0:1788448637.854801:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448637.854811:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854818:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804e2a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448637.854843:0:17146:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045313d0f reply state 00000000c91de98c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854854:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.854860:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc1bb7b4000) 00010000:00010000:2.0:1788448637.854863:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788448637.854865:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788448637.855019:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+10:15590:x1875323801173248:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 8841us (9031us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788448637.855029:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1788448637.949432:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448637.949608:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801173504 00000100:00100000:1.0:1788448637.949622:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801173504 00000100:00100000:1.0:1788448637.949704:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1788448637.949716:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+10:15598:x1875323801173504:12345-192.168.206.21@tcp:101:lctl.0 00010000:00010000:1.0:1788448637.949754:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448637.949778:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0a99 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.949843:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.949857:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.949867:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448637.949955:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448637.949960:0:17145:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448637.950020:0:17145:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.950053:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a99 expref: 12 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.950083:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fca00/0xf45a9e4e6b804e46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0a99 expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.950091:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:1.0:1788448637.950094:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448637.950097:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fca00, rc 0) 00000100:00100000:1.0:1788448637.950358:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+11:15598:x1875323801173504:12345-192.168.206.21@tcp:101:lctl.0 Request processed in 634us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448637.950366:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:3.0:1788448637.982607:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448637.987610:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801173632 00000100:00100000:2.0:1788448637.987627:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801173632 00000100:00100000:2.0:1788448637.987764:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:2.0:1788448637.987779:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:15599:x1875323801173632:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448637.987797:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448637.987817:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0aa0 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.987895:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5e00/0xf45a9e4e6b804e54 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.987910:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5e00/0xf45a9e4e6b804e54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.987951:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5e00/0xf45a9e4e6b804e54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448637.987994:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448637.987997:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448637.988015:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5e00/0xf45a9e4e6b804e54 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.988039:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aa0 expref: 7 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.988059:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5e00/0xf45a9e4e6b804e54 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aa0 expref: 6 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.988067:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:2.0:1788448637.988070:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448637.988074:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e5e00, rc 0) 00000100:00100000:2.0:1788448637.988164:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15599:x1875323801173632:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 389us (5567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448637.988172:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1788448637.992158:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448637.992376:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801173760 00000100:00100000:1.0:1788448637.992387:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801173760 00000100:00100000:1.0:1788448637.992447:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:1.0:1788448637.992459:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:15599:x1875323801173760:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:1.0:1788448637.992479:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448637.992500:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0aa7 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992564:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992578:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992589:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992600:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992621:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992628:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992708:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804e70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992716:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804e70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992722:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804e70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448637.992758:0:19479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448637.992762:0:19479:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448637.992783:0:19479:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804e70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992795:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992800:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992806:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992812:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448637.992816:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992830:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992841:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:1.0:1788448637.992844:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.992849:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992855:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804e62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992868:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992875:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992942:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992948:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fda00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448637.992951:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992956:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992963:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc1bb7b4000) 00010000:00010000:1.0:1788448637.992966:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448637.992968:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.992984:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804e69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.993013:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aa7 expref: 8 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.993027:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804e70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aa7 expref: 7 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.993033:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:1.0:1788448637.993035:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448637.993038:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fdc00, rc 0) 00000100:00100000:1.0:1788448637.993089:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+7:15599:x1875323801173760:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 632us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448637.993096:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:3.0:1788448637.998117:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448637.999525:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801173888 00000100:00100000:1.0:1788448637.999542:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801173888 00000100:00100000:1.0:1788448637.999621:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:1.0:1788448637.999632:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:15599:x1875323801173888:12345-192.168.206.21@tcp:900:lfs.0 00000100:00100000:1.0:1788448637.999715:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:15599:x1875323801173888:12345-192.168.206.21@tcp:900:lfs.0 Request processed in 85us (1623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448637.999724:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00080000:3.0:1788448637.999796:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788448638.007267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448638.007510:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801174144 00000100:00100000:0.0:1788448638.007520:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801174144 00000100:00100000:0.0:1788448638.007584:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:0.0:1788448638.007595:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+7:15599:x1875323801174144:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448638.007618:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448638.007638:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0aae expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448638.007736:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788448638.007836:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aae expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.007849:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:0.0:1788448638.007852:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448638.007857:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aae expref: 9 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.007869:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204ae00, rc 0) 00000100:00100000:0.0:1788448638.007969:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+8:15599:x1875323801174144:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 377us (870us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788448638.007989:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 32 00000100:00100000:3.0:1788448638.017997:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.018113:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801174400 00000100:00100000:1.0:1788448638.018124:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801174400 00000100:00100000:1.0:1788448638.018188:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:1.0:1788448638.018199:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+8:15599:x1875323801174400:12345-192.168.206.21@tcp:36:lfs.0 00010000:00010000:1.0:1788448638.018291:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448638.018320:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804e70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aa7 expref: 8 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.018725:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:1.0:1788448638.018730:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448638.018753:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.018767:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.018777:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448638.019005:0:17145:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002079f02a reply state 0000000038881003 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.019018:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.019024:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:1.0:1788448638.019027:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788448638.019030:0:17145:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788448638.019037:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788448638.019263:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+9:15599:x1875323801174400:12345-192.168.206.21@tcp:36:lfs.0 Request processed in 1064us (1275us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788448638.019270:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 33 00000100:00100000:3.0:1788448638.022123:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.024192:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801174656 00000100:00100000:1.0:1788448638.024208:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801174656 00000100:00100000:1.0:1788448638.024313:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1788448638.024341:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+9:15599:x1875323801174656:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:1.0:1788448638.024730:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+10:15599:x1875323801174656:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 404us (2622us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788448638.024738:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:3.0:1788448638.030424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448638.030673:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801174912 00000100:00100000:0.0:1788448638.030684:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801174912 00000100:00100000:0.0:1788448638.030743:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:0.0:1788448638.030754:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+10:15599:x1875323801174912:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:0.0:1788448638.030790:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448638.030811:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804e8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ab5 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.030986:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.031003:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.031015:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.034264:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.034290:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.034303:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448638.035784:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788448638.035873:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.035911:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.035918:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036553:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ae00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448638.036560:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036569:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036603:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:3.0:1788448638.036606:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448638.036612:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036618:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804e93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036637:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036644:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036650:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036655:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448638.036658:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036664:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036672:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc1bb7b4000) 00010000:00010000:3.0:1788448638.036674:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448638.036677:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036683:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b804e9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036746:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804e8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ab5 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036757:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:3.0:1788448638.036760:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448638.036764:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804e8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ab5 expref: 12 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448638.036775:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b400, rc 0) 00000100:00100000:3.0:1788448638.036860:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+11:15599:x1875323801174912:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 6108us (6445us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788448638.036870:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 34 00000100:00100000:0.0:1788448638.048180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448638.048686:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801175040 00000100:00100000:2.0:1788448638.048697:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801175040 00000100:00100000:2.0:1788448638.048770:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:2.0:1788448638.048784:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+11:15599:x1875323801175040:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448638.048820:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448638.048845:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804ea8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0abc expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.048982:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.048997:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.049010:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448638.049039:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788448638.049043:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788448638.049062:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.049087:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804ea8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 13 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.049113:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.049121:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:2.0:1788448638.049137:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448638.049141:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4600, rc 0) 00000100:00100000:2.0:1788448638.049197:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+12:15599:x1875323801175040:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 417us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448638.049205:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 35 00000100:00100000:0.0:1788448638.062690:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.063053:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801175168 00000100:00100000:1.0:1788448638.063064:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801175168 00000100:00100000:1.0:1788448638.063135:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 3 00000100:00100000:1.0:1788448638.063147:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+12:15599:x1875323801175168:12345-192.168.206.21@tcp:37:lfs.0 00000100:00100000:1.0:1788448638.077562:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+12:15599:x1875323801175168:12345-192.168.206.21@tcp:37:lfs.0 Request processed in 14407us (14876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.077577:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 3 00000040:00080000:1.0:1788448638.079152:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448638.089600:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448638.089698:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801175424 00000100:00100000:3.0:1788448638.089712:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801175424 00000100:00100000:3.0:1788448638.089784:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 4 00000100:00100000:3.0:1788448638.089795:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb71b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+12:15599:x1875323801175424:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448638.090079:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb71b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+13:15599:x1875323801175424:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 284us (491us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788448638.090087:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 4 00000040:00080000:3.0:1788448638.142837:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448638.143492:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826426880:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143582:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143624:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826427392:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143646:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143662:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826427904:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143685:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143723:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788448638.143729:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826426752:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143757:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143783:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826427264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143806:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143823:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826427776:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143843:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143864:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143906:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143933:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826427008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143958:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.143976:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.143996:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.144014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826428032:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144033:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.144046:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788448638.144051:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc082018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826427136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.144087:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826427648:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144118:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.144136:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826428160:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144162:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448638.144189:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826426880 00000100:00100000:0.0:1788448638.144196:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826426880 00000100:00100000:0.0:1788448638.144241:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427392 00000100:00100000:0.0:1788448638.144250:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427392 00000100:00100000:0.0:1788448638.144271:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448638.144279:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826426880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144334:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826426880:12345-0@lo:400:kworker.0 Request processed in 54us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144341:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448638.144358:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448638.144365:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826427392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144392:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826427392:12345-0@lo:400:kworker.0 Request processed in 28us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144398:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448638.144420:0:17138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826426752 00000100:00100000:0.0:1788448638.144424:0:17138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826426752 00000100:00100000:0.0:1788448638.144448:0:17138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788448638.144455:0:17138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144484:0:17138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3648:x1875323826426752:12345-0@lo:400:kworker.0 Request processed in 30us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144490:0:17138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788448638.144518:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427008 00000100:00100000:0.0:1788448638.144522:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427008 00000100:00100000:0.0:1788448638.144560:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427520 00000100:00100000:0.0:1788448638.144563:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427520 00000100:00100000:0.0:1788448638.144592:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427136 00000100:00100000:0.0:1788448638.144594:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427136 00000100:00100000:0.0:1788448638.144606:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427648 00000100:00100000:0.0:1788448638.144608:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427648 00000100:00100000:0.0:1788448638.144621:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448638.144627:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144670:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826427008:12345-0@lo:400:kworker.0 Request processed in 43us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144675:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448638.144687:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448638.144692:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826427520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144716:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826427520:12345-0@lo:400:kworker.0 Request processed in 25us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144722:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448638.144733:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448638.144738:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826427136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144766:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826427136:12345-0@lo:400:kworker.0 Request processed in 29us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144771:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448638.144783:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448638.144788:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826427648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144812:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826427648:12345-0@lo:400:kworker.0 Request processed in 24us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.144817:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788448638.144839:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448638.144843:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448638.144870:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826427136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144904:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826427648:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144916:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826427008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144925:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826427520:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144967:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:943bfcb5-816e-4cdd-a66b-4e69884ef502:3648:1875323826426752:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144979:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826426880:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.144987:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826427392:0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145254:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427904 00000100:00100000:1.0:1788448638.145259:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427904 00000100:00100000:1.0:1788448638.145293:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427264 00000100:00100000:1.0:1788448638.145297:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427264 00000100:00100000:1.0:1788448638.145309:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826427776 00000100:00100000:1.0:1788448638.145313:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826427776 00000100:00100000:1.0:1788448638.145323:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826428288 00000100:00100000:1.0:1788448638.145326:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826428288 00000100:00100000:1.0:1788448638.145339:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826428032 00000100:00100000:1.0:1788448638.145342:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826428032 00000100:00100000:1.0:1788448638.145369:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826428160 00000100:00100000:1.0:1788448638.145373:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826428160 00000100:00100000:1.0:1788448638.145388:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788448638.145395:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826427904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145439:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0834f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826427904:12345-0@lo:400:kworker.0 Request processed in 45us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.145451:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788448638.145468:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448638.145474:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826427264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145502:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826427264:12345-0@lo:400:kworker.0 Request processed in 29us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.145508:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448638.145519:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448638.145525:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826427776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145552:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826427776:12345-0@lo:400:kworker.0 Request processed in 27us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.145558:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448638.145570:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788448638.145576:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826428288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145600:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826428288:12345-0@lo:400:kworker.0 Request processed in 26us (1694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.145605:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788448638.145615:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448638.145621:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826428032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145651:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826428032:12345-0@lo:400:kworker.0 Request processed in 30us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.145656:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448638.145668:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448638.145675:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826428160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448638.145703:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826428160:12345-0@lo:400:kworker.0 Request processed in 29us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.145715:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788448638.145732:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448638.145735:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448638.145758:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826428160:0@lo:400:kworker.0 00010000:00080000:1.0:1788448638.145772:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc08341f480 x1875323826428032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448638.145783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826428032:0@lo:400:kworker.0 00000100:00100000:2.0:1788448638.148373:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448638.148402:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826428416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448638.148476:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448638.148774:0:18653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826428416 00000100:00100000:1.0:1788448638.148784:0:18653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826428416 00000100:00100000:1.0:1788448638.148841:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448638.148852:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826428416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448638.148905:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788448638.148969:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826428416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.148976:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448638.151151:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448638.151177:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826428544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448638.151251:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448638.151325:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826428544 00000100:00100000:3.0:1788448638.151622:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826428544 00000100:00100000:3.0:1788448638.151693:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448638.151703:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826428544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788448638.151728:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788448638.151775:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826428544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448638.151782:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448638.151831:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826428544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788448638.151973:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826428416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448638.154106:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc082018000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826427264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.154144:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826427776:0@lo:400:kworker.0 00010000:00080000:0.0:1788448638.154159:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f7b80 x1875323826428288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448654 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448638.154171:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826428288:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.154184:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826427904:0@lo:400:kworker.0 00000100:00100000:0.0:1788448638.213293:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.213916:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801175552 00000100:00100000:1.0:1788448638.213926:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801175552 00000100:00100000:1.0:1788448638.213996:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:1.0:1788448638.214007:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+11:15605:x1875323801175552:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448638.214029:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448638.214050:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804eb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ac3 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214122:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214153:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214164:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214176:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214183:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214188:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214282:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804ecb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214291:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804ecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214298:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804ecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448638.214346:0:19479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788448638.214350:0:19479:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788448638.214394:0:19479:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804ecb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214406:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214422:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214429:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214434:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fda00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448638.214439:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214446:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214458:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:1.0:1788448638.214461:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448638.214465:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214471:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214483:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214489:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214495:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214500:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448638.214509:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214515:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214523:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc1bb7b4000) 00010000:00010000:1.0:1788448638.214525:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448638.214528:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214532:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ec4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214558:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804eb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ac3 expref: 13 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214570:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd400/0xf45a9e4e6b804ecb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ac3 expref: 12 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.214577:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:1.0:1788448638.214579:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788448638.214581:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fd400, rc 0) 00000100:00100000:1.0:1788448638.214642:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+12:15605:x1875323801175552:12345-192.168.206.21@tcp:101:bash.0 Request processed in 636us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.214649:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 36 00000100:00100000:0.0:1788448638.218939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.219124:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801175680 00000100:00100000:1.0:1788448638.219134:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801175680 00000100:00100000:1.0:1788448638.219193:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:1.0:1788448638.219205:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:15605:x1875323801175680:12345-192.168.206.21@tcp:900:bash.0 00000100:00100000:1.0:1788448638.219506:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183ea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:15605:x1875323801175680:12345-192.168.206.21@tcp:900:bash.0 Request processed in 302us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.219515:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448638.226839:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.226974:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801175936 00000100:00100000:1.0:1788448638.226986:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801175936 00000100:00100000:1.0:1788448638.227066:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:1.0:1788448638.227079:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+12:15605:x1875323801175936:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:1.0:1788448638.227109:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448638.227131:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804ed2 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0aca expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.227251:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.227267:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.227276:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.227312:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 12 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.227325:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 12 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448638.227339:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826428672:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448638.227434:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1c1286c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448638.231117:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826428672:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448638.231167:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448638.232049:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448638.232159:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801176064 00000100:00100000:2.0:1788448638.232169:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801176064 00010000:00010000:2.0:1788448638.232238:0:17130:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 13 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448638.232295:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788448638.232308:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+13:2399:x1875323801176064:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448638.232325:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448638.232345:0:17130:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 13 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.232359:0:17130:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 13 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.232384:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804eaf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0abc expref: 13 pid: 17147 timeout: 655 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.232401:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:2.0:1788448638.232423:0:17130:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.232435:0:17130:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.232445:0:17130:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.232480:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448638.232544:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+12:2399:x1875323801176064:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 240us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448638.232551:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00010000:00010000:1.0:1788448638.232684:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.232693:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.232720:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.232731:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.232739:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233289:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233300:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233308:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448638.233317:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788448638.233344:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233366:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233373:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233379:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:1.0:1788448638.233384:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233390:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233401:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:1.0:1788448638.233404:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448638.233408:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233414:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804ed9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448638.233427:0:17146:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5d0dd3c reply state 000000005544d77e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233437:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233443:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fc08319b600) 00010000:00010000:1.0:1788448638.233445:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448638.233448:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788448638.233487:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fdc00/0xf45a9e4e6b804ed2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 15 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233508:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 14 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448638.233516:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448638.233518:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788448638.233521:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fc400, rc 0) 00000100:00100000:1.0:1788448638.233563:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc183eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+15:15605:x1875323801175936:12345-192.168.206.21@tcp:101:bash.0 Request processed in 6486us (6739us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788448638.233571:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 37 00000100:00100000:3.0:1788448638.261562:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.262701:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801176192 00000100:00100000:1.0:1788448638.262717:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801176192 00000100:00100000:0.0:1788448638.266675:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1788448638.266690:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+15:15605:x1875323801176192:12345-192.168.206.21@tcp:101:bash.0 00010000:00010000:0.0:1788448638.266715:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448638.266738:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804ef5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ad1 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.266821:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.266836:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.266863:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448638.266950:0:19479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788448638.266955:0:19479:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448638.266984:0:19479:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.266996:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.267023:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804ef5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 17 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.267043:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 16 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.267052:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448638.267055:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448638.267059:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204a400, rc 0) 00000100:00100000:0.0:1788448638.267157:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+16:15605:x1875323801176192:12345-192.168.206.21@tcp:101:bash.0 Request processed in 470us (5607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.267165:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 38 00000100:00100000:0.0:1788448638.283973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448638.284048:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801176448 00000100:00100000:3.0:1788448638.284060:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801176448 00000100:00100000:3.0:1788448638.284116:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 5 00000100:00100000:3.0:1788448638.284128:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+16:15605:x1875323801176448:12345-192.168.206.21@tcp:35:bash.0 00000001:00080000:3.0:1788448638.284380:0:17148:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934601 00000100:00100000:3.0:1788448638.284496:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+18:15605:x1875323801176448:12345-192.168.206.21@tcp:35:bash.0 Request processed in 368us (533us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788448638.284505:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 5 00000020:00080000:3.0:1788448638.284509:0:17148:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788448638.410531:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448638.410678:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801176704 00000100:00100000:2.0:1788448638.410690:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801176704 00000100:00100000:2.0:1788448638.410770:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:2.0:1788448638.410784:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+18:15615:x1875323801176704:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448638.410823:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448638.410847:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ad8 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448638.411022:0:17147:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788448638.411151:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f03 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad8 expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.411166:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9fc08319bf00) 00010000:00010000:2.0:1788448638.411169:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448638.411175:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad8 expref: 20 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.411209:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4600, rc 0) 00000100:00100000:2.0:1788448638.411289:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+19:15615:x1875323801176704:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 508us (778us total) trans 8589934603 rc 301/301 00000100:00100000:2.0:1788448638.411298:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 39 00000100:00100000:0.0:1788448638.419064:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448638.419203:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801176960 00000100:00100000:3.0:1788448638.419214:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801176960 00000100:00100000:3.0:1788448638.419351:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:3.0:1788448638.419364:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+19:15615:x1875323801176960:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:3.0:1788448638.419640:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+20:15615:x1875323801176960:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 278us (587us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788448638.419648:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 6 00000100:00100000:0.0:1788448638.548097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448638.548270:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801177216 00000100:00100000:2.0:1788448638.548283:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801177216 00000100:00100000:2.0:1788448638.548387:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:2.0:1788448638.548400:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+20:15618:x1875323801177216:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788448638.548427:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448638.548451:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f11 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0adf expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.548576:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804f18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.548592:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804f18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.548602:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804f18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448638.548614:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788448638.548722:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f11 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0adf expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.548740:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804f18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0adf expref: 22 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.548779:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448638.548781:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448638.548785:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4a00, rc 0) 00000100:00100000:2.0:1788448638.548851:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+22:15618:x1875323801177216:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 455us (764us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788448638.548858:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 40 00000100:00100000:0.0:1788448638.557220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448638.557284:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.557530:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801177472 00000100:00100000:1.0:1788448638.557543:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801177472 00000100:00100000:2.0:1788448638.557613:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801177344 00000100:00100000:2.0:1788448638.557618:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801177344 00000100:00100000:1.0:1788448638.557621:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:1.0:1788448638.557631:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+23:2399:x1875323801177472:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448638.557648:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788448638.557676:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 41 00010000:00010000:1.0:1788448638.557676:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4a00/0xf45a9e4e6b804f18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0adf expref: 23 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448638.557685:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+23:15618:x1875323801177344:12345-192.168.206.21@tcp:54:lfs.0 00010000:00010000:1.0:1788448638.557696:0:20175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448638.557700:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448638.557740:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448638.557754:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+22:2399:x1875323801177472:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 124us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448638.557762:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00010000:00010000:2.0:1788448638.557819:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557832:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557869:0:17147:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557877:0:17147:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557914:0:17147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557920:0:17147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4600 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448638.557932:0:17147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557940:0:17147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557950:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448638.557954:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448638.557957:0:17147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.557964:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f26 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448638.558108:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08341dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+21:15618:x1875323801177344:12345-192.168.206.21@tcp:54:lfs.0 Request processed in 424us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448638.558115:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 41 00000100:00100000:3.0:1788448638.571280:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448638.571501:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801177728 00000100:00100000:0.0:1788448638.571761:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801177728 00000100:00100000:0.0:1788448638.571986:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 7 00000100:00100000:0.0:1788448638.571997:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+21:15618:x1875323801177728:12345-192.168.206.21@tcp:35:lfs.0 00000100:00100000:0.0:1788448638.572382:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc19137d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+22:15618:x1875323801177728:12345-192.168.206.21@tcp:35:lfs.0 Request processed in 384us (1108us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788448638.572390:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 7 00010000:00010000:0.0:1788448638.656696:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448638.972396:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448638.972522:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801177984 00000100:00100000:2.0:1788448638.972534:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801177984 00000100:00100000:2.0:1788448638.972620:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:2.0:1788448638.972632:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+22:15649:x1875323801177984:12345-192.168.206.21@tcp:101:cat.0 00010000:00010000:2.0:1788448638.972655:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448638.972676:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f2d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0ae6 expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.972792:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5c00/0xf45a9e4e6b804f34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.972808:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5c00/0xf45a9e4e6b804f34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.972834:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5c00/0xf45a9e4e6b804f34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448638.972847:0:17145:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788448638.973693:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4600/0xf45a9e4e6b804f2d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ae6 expref: 25 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.973718:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5c00/0xf45a9e4e6b804f34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ae6 expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448638.973726:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448638.973729:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448638.973733:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e5c00, rc 0) 00000100:00100000:2.0:1788448638.973860:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+24:15649:x1875323801177984:12345-192.168.206.21@tcp:101:cat.0 Request processed in 1230us (1474us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788448638.973869:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 42 00000100:00100000:3.0:1788448638.986669:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448638.986715:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448638.987134:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801178368 00000100:00100000:1.0:1788448638.987146:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801178368 00000100:00100000:1.0:1788448638.987218:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:1.0:1788448638.987239:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+24:15649:x1875323801178368:12345-192.168.206.21@tcp:35:cat.0 00000100:00100000:1.0:1788448638.987593:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+25:15649:x1875323801178368:12345-192.168.206.21@tcp:35:cat.0 Request processed in 355us (876us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788448638.987600:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 8 00000100:00100000:0.0:1788448638.988088:0:20174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801178112 00000100:00100000:0.0:1788448638.988101:0:20174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801178112 00000100:00100000:0.0:1788448638.988146:0:20174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:0.0:1788448638.988155:0:20174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+25:2401:x1875323801178112:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448638.988168:0:20174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448638.988192:0:20174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5c00/0xf45a9e4e6b804f34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ae6 expref: 25 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448638.988212:0:20174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448638.988217:0:20174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448638.988252:0:20174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083689500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+24:2401:x1875323801178112:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 98us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448638.988260:0:20174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:3.0:1788448639.062052:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448639.062163:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801178624 00000100:00100000:0.0:1788448639.062177:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801178624 00000100:00080000:1.0:1788448639.062266:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448639.062275:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:0.0:1788448639.062289:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+24:15655:x1875323801178624:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788448639.062314:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448639.062358:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f42 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0aed expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062469:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062485:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 25 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062494:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 25 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062503:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062552:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 25 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062565:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 25 pid: 19479 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448639.062579:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826428800:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448639.062688:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 25 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.062698:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 25 pid: 17146 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448639.062708:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826428928:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448639.062736:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b76480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448639.065440:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448639.065505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448639.065562:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826428800:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448639.065571:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801178880 00000100:00100000:0.0:1788448639.065582:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826428928:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448639.065584:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801178880 00010000:00010000:0.0:1788448639.065608:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.065638:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 26 pid: 17146 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448639.065679:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801178752 00000100:00100000:1.0:1788448639.065684:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801178752 00010000:00010000:1.0:1788448639.065700:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 27 pid: 19479 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448639.065730:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:2.0:1788448639.065775:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+27:2399:x1875323801178880:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448639.065800:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448639.065813:0:20175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 27 pid: 17146 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.065832:0:20175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 27 pid: 17146 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.065861:0:20175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804ee7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aca expref: 27 pid: 17146 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448639.065927:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1788448639.065945:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0837be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+26:2399:x1875323801178752:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448639.065954:0:20175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448639.065963:0:20175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.065964:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448639.065980:0:20175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.065981:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 26 pid: 19479 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.066012:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448639.066027:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 26 pid: 19479 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.066055:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804efc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0ad1 expref: 26 pid: 19479 timeout: 656 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448639.066081:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+25:2399:x1875323801178880:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 337us (655us total) trans 0 rc 0/0 00010000:00010000:1.0:1788448639.066088:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448639.066099:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448639.066104:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00010000:00010000:1.0:1788448639.066109:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.066118:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.066159:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448639.066207:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0837be050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+24:2399:x1875323801178752:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 267us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448639.066216:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00010000:00010000:1.0:1788448639.066324:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.066347:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448639.066366:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788448639.066507:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f42 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aed expref: 25 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.066522:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a600/0xf45a9e4e6b804f49 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0aed expref: 24 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.066529:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448639.066537:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448639.066541:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204a600, rc 0) 00000100:00100000:1.0:1788448639.066582:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+24:15655:x1875323801178624:12345-192.168.206.21@tcp:101:dd.0 Request processed in 4298us (4545us total) trans 8589934609 rc 0/0 00000100:00100000:1.0:1788448639.066588:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 43 00000100:00100000:1.0:1788448639.072797:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448639.072927:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801179008 00000100:00100000:2.0:1788448639.072938:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801179008 00000100:00100000:2.0:1788448639.073001:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1788448639.073018:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+24:15655:x1875323801179008:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788448639.073051:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448639.073071:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804f57 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0af4 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.073110:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.073124:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.073135:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.073274:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804f57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 26 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.073293:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 25 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448639.073301:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448639.073305:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448639.073308:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4000, rc 0) 00000100:00100000:2.0:1788448639.073372:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+25:15655:x1875323801179008:12345-192.168.206.21@tcp:101:dd.0 Request processed in 359us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448639.073380:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:2.0:1788448639.082640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448639.083522:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801179264 00000100:00100000:0.0:1788448639.083536:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801179264 00000100:00100000:1.0:1788448639.083715:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 45 00000100:00100000:1.0:1788448639.083728:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+25:15655:x1875323801179264:12345-192.168.206.21@tcp:36:dd.0 00010000:00010000:1.0:1788448639.083981:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.083999:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.084010:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448639.084053:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934610 00000004:00010000:1.0:1788448639.084076:0:17146:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5c6cc2b reply state 000000000ca956e5 transno 8589934611 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.084088:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.084096:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448639.084098:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788448639.084102:0:17146:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448639.084209:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+28:15655:x1875323801179264:12345-192.168.206.21@tcp:36:dd.0 Request processed in 483us (1581us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788448639.084216:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 45 00000020:00080000:1.0:1788448639.084247:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788448639.089558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448639.090108:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801179392 00000100:00100000:0.0:1788448639.090122:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801179392 00000100:00100000:0.0:1788448639.090191:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:0.0:1788448639.090201:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+28:15655:x1875323801179392:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788448639.090256:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448639.090277:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f6c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0afb expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.090358:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0afb expref: 29 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.090374:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f6c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0afb expref: 29 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.090395:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448639.090398:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448639.090402:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204ae00, rc 0) 00000100:00100000:0.0:1788448639.090467:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15655:x1875323801179392:12345-192.168.206.21@tcp:101:dd.0 Request processed in 266us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448639.090499:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:3.0:1788448639.112587:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448639.125233:0:17130:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801179648 00000100:00100000:1.0:1788448639.125250:0:17130:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801179648 00000100:00100000:1.0:1788448639.125334:0:17130:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:1.0:1788448639.125357:0:17130:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15655:x1875323801179648:12345-192.168.206.21@tcp:103:dd.0 00010000:00010000:1.0:1788448639.125377:0:17130:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448639.125415:0:17130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f6c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0afb expref: 29 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.125441:0:17130:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448639.125448:0:17130:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448639.125545:0:17130:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+28:15655:x1875323801179648:12345-192.168.206.21@tcp:103:dd.0 Request processed in 201us (12969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448639.125552:0:17130:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2 00000100:00100000:2.0:1788448639.129351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448639.129725:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801179776 00000100:00100000:1.0:1788448639.129737:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801179776 00000100:00100000:1.0:1788448639.129804:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:1.0:1788448639.129815:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+28:15655:x1875323801179776:12345-192.168.206.21@tcp:58:dd.0 00010000:00010000:1.0:1788448639.129956:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.129974:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448639.129986:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448639.134125:0:17146:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448639.142191:0:17146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788448639.142389:0:17146:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788448639.142549:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+28:15655:x1875323801179776:12345-192.168.206.21@tcp:58:dd.0 Request processed in 12726us (13202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448639.142565:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 47 00000100:00100000:3.0:1788448639.145864:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448639.150518:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801179904 00000100:00100000:0.0:1788448639.150540:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801179904 00000100:00100000:0.0:1788448639.150622:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 48 00000100:00100000:0.0:1788448639.150633:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+28:15655:x1875323801179904:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788448639.150658:0:19479:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448639.150679:0:19479:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b02 expref: -99 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.150734:0:19479:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.150745:0:19479:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 29 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.150765:0:19479:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.150778:0:19479:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 29 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.150792:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448639.150808:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448639.150813:0:19479:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 29 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448639.150822:0:19479:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b400, rc 0) 00000100:00100000:0.0:1788448639.150932:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15655:x1875323801179904:12345-192.168.206.21@tcp:101:dd.0 Request processed in 300us (5110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448639.150940:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 48 00010000:00010000:2.0:1788448639.678388:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448640.126460:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788448640.126471:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448640.126499:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788448640.126509:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788448640.126672:0:17181:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17181:1875323826429056:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448640.126777:0:17181:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc192b760c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448640.133071:0:17181:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17181:1875323826429056:192.168.206.21@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448640.144250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.161253:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801180032 00000100:00100000:0.0:1788448640.161271:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801180032 00000100:00100000:0.0:1788448640.161360:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:0.0:1788448640.161372:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15656:x1875323801180032:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448640.161409:0:17147:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448640.161570:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083e21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15656:x1875323801180032:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 199us (17327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.161579:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:3.0:1788448640.170511:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.175264:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801180160 00000100:00100000:0.0:1788448640.175279:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801180160 00000100:00100000:0.0:1788448640.175420:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:0.0:1788448640.175433:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15656:x1875323801180160:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.175538:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175555:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175567:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175622:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175631:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175638:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175660:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175667:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175673:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448640.175716:0:19479:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788448640.175720:0:19479:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448640.175736:0:19479:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175760:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175774:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175782:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175789:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204ae00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448640.175793:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175801:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175814:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08319b700) 00010000:00010000:0.0:1788448640.175817:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448640.175822:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175828:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804f81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175844:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175851:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175857:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175863:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204b800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448640.175874:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175908:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175918:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9fc185378800) 00010000:00010000:0.0:1788448640.175921:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448640.175924:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175930:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804f88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175944:0:19479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175950:0:19479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175956:0:19479:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175961:0:19479:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448640.175964:0:19479:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175970:0:19479:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175978:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448640.175980:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448640.175989:0:19479:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.175996:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804f8f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.176097:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15656:x1875323801180160:12345-192.168.206.21@tcp:34:lhsmtool_posix.0 Request processed in 665us (5595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.176106:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:3.0:1788448640.181614:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.182026:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801180416 00000100:00100000:2.0:1788448640.182037:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801180416 00000100:00100000:2.0:1788448640.182166:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:2.0:1788448640.182179:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+29:15656:x1875323801180416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448640.182199:0:17146:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448640.182230:0:17146:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804f96 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b09 expref: -99 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183566:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183588:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183614:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448640.183627:0:17146:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788448640.183724:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183732:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183738:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183744:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.183748:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183755:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183767:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448640.183770:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788448640.183775:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183781:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804f9d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183829:0:17146:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804f96 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b09 expref: 31 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183851:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9fc08319b700) 00010000:00010000:2.0:1788448640.183854:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448640.183858:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804f96 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b09 expref: 31 pid: 17146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.183868:0:17146:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4200, rc 0) 00000100:00100000:2.0:1788448640.183970:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+30:15656:x1875323801180416:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 1794us (2365us total) trans 8589934612 rc 301/301 00000100:00100000:2.0:1788448640.183979:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:3.0:1788448640.200267:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.200377:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801180544 00000100:00100000:2.0:1788448640.200387:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801180544 00000100:00100000:2.0:1788448640.200456:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:2.0:1788448640.200467:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+30:15656:x1875323801180544:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448640.200498:0:17145:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448640.200627:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+30:15656:x1875323801180544:12345-192.168.206.21@tcp:53:lhsmtool_posix.0 Request processed in 162us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448640.200635:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 52 00000100:00100000:1.0:1788448640.216113:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.216222:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801180800 00000100:00100000:0.0:1788448640.216234:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801180800 00000100:00100000:0.0:1788448640.216306:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:0.0:1788448640.216319:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+30:15656:x1875323801180800:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.216350:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448640.216374:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fab lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b10 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448640.216784:0:17147:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1788448640.216791:0:17147:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788448640.216809:0:17147:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788448640.217018:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fb2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.217033:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.217045:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.217103:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fab lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b10 expref: 33 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.217136:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b10 expref: 32 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.217145:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378800) 00010000:00010000:0.0:1788448640.217148:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448640.217151:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b800, rc 0) 00000100:00100000:0.0:1788448640.217227:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+32:15656:x1875323801180800:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 910us (1126us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788448640.217235:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:3.0:1788448640.228675:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.229052:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801181056 00000100:00100000:2.0:1788448640.229065:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801181056 00000100:00100000:2.0:1788448640.229169:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1788448640.229186:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+32:15656:x1875323801181056:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788448640.229261:0:17145:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448640.229297:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fb2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b10 expref: 32 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229335:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378800) 00010000:00010000:2.0:1788448640.229674:0:17145:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448640.229705:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229721:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229732:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229758:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229767:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229773:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229837:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229844:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229851:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229857:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4200 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.229862:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.229878:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230138:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:2.0:1788448640.230142:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448640.230145:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230152:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4200/0xf45a9e4e6b804fc0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230163:0:17145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230169:0:17145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230175:0:17145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230181:0:17145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.230183:0:17145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230189:0:17145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230196:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x73ac1856 (ffff9fc1bb7b4800) 00010000:00010000:2.0:1788448640.230199:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448640.230201:0:17145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.230233:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4800/0xf45a9e4e6b804fc7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x73ac1856 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448640.230364:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+31:15656:x1875323801181056:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 1182us (1696us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788448640.230374:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1788448640.238276:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.238488:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801181184 00000100:00100000:0.0:1788448640.238498:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801181184 00000100:00100000:0.0:1788448640.238572:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:0.0:1788448640.238583:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+31:15656:x1875323801181184:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.238604:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448640.238630:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fce lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b17 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.238670:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804fd5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.238685:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.238698:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804fd5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.238823:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b17 expref: 33 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.238852:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204ae00/0xf45a9e4e6b804fd5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b17 expref: 32 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.238861:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.238864:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448640.238868:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204ae00, rc 0) 00000100:00100000:0.0:1788448640.238983:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc0836e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+32:15656:x1875323801181184:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 400us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.238992:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:3.0:1788448640.246731:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.247289:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801181440 00000100:00100000:0.0:1788448640.247300:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801181440 00000100:00100000:0.0:1788448640.247371:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:0.0:1788448640.247383:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+32:15656:x1875323801181440:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.247477:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.247496:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.247509:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448640.247692:0:19479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788448640.247703:0:19479:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 557592820692ns, next at 558592818452ns, rc = 0 00000004:00010000:0.0:1788448640.247763:0:19479:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041264683 reply state 00000000029a1fbf transno 8589934614 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.247793:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.247801:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.247803:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788448640.247807:0:19479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448640.247924:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+34:15656:x1875323801181440:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 543us (1201us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788448640.247931:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:3.0:1788448640.253552:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.253718:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801181568 00000100:00100000:0.0:1788448640.253729:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801181568 00000100:00100000:0.0:1788448640.253807:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1788448640.253819:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+34:15656:x1875323801181568:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.253850:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448640.253923:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b1e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.253986:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 35 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.254002:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 35 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.254032:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.254035:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448640.254040:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1c204b800, rc 0) 00000100:00100000:0.0:1788448640.254112:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+35:15656:x1875323801181568:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 295us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.254134:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:3.0:1788448640.265094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.265310:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801181696 00000100:00100000:0.0:1788448640.265323:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801181696 00000100:00100000:0.0:1788448640.265407:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1788448640.265418:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801181696:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788448640.265604:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448640.269519:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2400:x1875323801181696:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 4089us (4434us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788448640.269535:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:3.0:1788448640.273257:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.273679:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801181952 00000100:00100000:2.0:1788448640.273689:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801181952 00000100:00100000:2.0:1788448640.273773:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:2.0:1788448640.273787:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+35:15656:x1875323801181952:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448640.274058:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+36:15656:x1875323801181952:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 275us (810us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788448640.274066:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:3.0:1788448640.278555:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.278716:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801182208 00000100:00100000:0.0:1788448640.278726:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801182208 00000100:00100000:0.0:1788448640.278795:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:0.0:1788448640.278805:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+36:15656:x1875323801182208:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448640.278948:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+36:15656:x1875323801182208:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.278956:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:3.0:1788448640.282377:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.282586:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801182336 00000100:00100000:0.0:1788448640.282595:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801182336 00000100:00100000:0.0:1788448640.282651:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:0.0:1788448640.282660:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1ba1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+36:15656:x1875323801182336:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.282677:0:17147:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448640.282696:0:17147:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804fea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b25 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.282770:0:17147:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b804ff1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.282783:0:17147:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b804ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.282809:0:17147:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b804ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448640.282848:0:17147:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788448640.282864:0:17147:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b804ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17147 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.282926:0:17147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1a0330000/0xf45a9e4e6b804fea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b25 expref: 38 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.282942:0:17147:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b804ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b25 expref: 37 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.282950:0:17147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.282953:0:17147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788448640.282956:0:17147:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc182c1fc00, rc 0) 00000100:00100000:0.0:1788448640.283005:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1ba1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+37:15656:x1875323801182336:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 346us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.283011:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:1.0:1788448640.291959:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.292079:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801182464 00000100:00100000:2.0:1788448640.292089:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801182464 00000100:00100000:2.0:1788448640.292178:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:2.0:1788448640.292192:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+6:2399:x1875323801182464:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448640.292222:0:18650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448640.292246:0:18650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b2c expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448640.292277:0:18650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998f80, blocks: 0x0 00010000:00010000:2.0:1788448640.292318:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=557s v=(0 0) 00010000:00010000:2.0:1788448640.292326:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448640.292351:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 7 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.292373:0:18650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 7 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.292388:0:18650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e4800, rc 0) 00000100:00100000:2.0:1788448640.292458:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2399:x1875323801182464:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 270us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448640.292466:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:3.0:1788448640.296361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.296533:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801182720 00000100:00100000:0.0:1788448640.296545:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801182720 00000100:00100000:0.0:1788448640.296606:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:0.0:1788448640.296616:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+37:15656:x1875323801182720:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448640.296729:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+37:15656:x1875323801182720:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 113us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.296736:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:3.0:1788448640.300500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.302452:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801182848 00000100:00100000:0.0:1788448640.302498:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801182848 00000100:00100000:1.0:1788448640.302909:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:1.0:1788448640.302933:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+37:15656:x1875323801182848:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788448640.308074:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000004:00080000:0.0:1788448640.308101:0:17125:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788448640.308141:0:17125:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788448640.308386:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bf7c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+19:15656:x1875323801182848:12345-192.168.206.21@tcp:44:lhsmtool_posix.0 Request processed in 5451us (8051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448640.308397:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00010000:00010000:3.0:1788448640.308875:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.308905:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.308924:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.308944:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd800 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448640.308948:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.308955:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.308970:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:3.0:1788448640.308973:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788448640.308978:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.308984:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd800/0xf45a9e4e6b804e85 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.311043:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448640.311071:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826429184:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788448640.311150:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448640.312052:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826429184 00000100:00100000:3.0:1788448640.312063:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826429184 00000100:00100000:3.0:1788448640.312135:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448640.312145:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826429184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788448640.312291:0:19177:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788448640.312294:0:19177:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788448640.312297:0:19177:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788448640.312299:0:19177:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788448640 -> 1788448640 00002000:00010000:3.0:1788448640.312302:0:19177:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788448640.312368:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3645:x1875323826429184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 224us (1217us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788448640.312376:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:3.0:1788448640.312426:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9fc1bf7c8380/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788448640.312446:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bf7c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826429184:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788448640.313319:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448640.314431:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314446:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314454:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314460:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e4c00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.314464:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314472:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314488:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9fc1bb7b4000) 00010000:00010000:2.0:1788448640.314497:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448640.314501:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314508:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4c00/0xf45a9e4e6b804e31 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314532:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314539:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314552:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314557:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5a00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.314560:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314566:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314573:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9fc1bb7b4200) 00010000:00010000:2.0:1788448640.314576:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448640.314578:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.314583:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5a00/0xf45a9e4e6b804e38 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315368:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315388:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315395:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315400:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fda00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.315403:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315409:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315421:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9fc08319b600) 00010000:00010000:2.0:1788448640.315423:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448640.315426:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315433:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fda00/0xf45a9e4e6b804ee0 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315448:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315454:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315460:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315465:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.315471:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315478:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315485:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448640.315487:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448640.315489:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315495:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fc400/0xf45a9e4e6b804f65 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315505:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315510:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315516:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315521:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1c204a400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:2.0:1788448640.315523:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315528:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315537:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:2.0:1788448640.315539:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788448640.315556:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.315562:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204a400/0xf45a9e4e6b804fdc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.321205:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.321349:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801182976 00000100:00100000:2.0:1788448640.321360:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801182976 00000100:00100000:2.0:1788448640.321444:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:2.0:1788448640.321457:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2398:x1875323801182976:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788448640.321565:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2398:x1875323801182976:12345-192.168.206.21@tcp:16:lhsmtool_posix.0 Request processed in 111us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448640.321573:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:3.0:1788448640.333502:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.333656:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801183232 00000100:00100000:0.0:1788448640.333680:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801183232 00000100:00100000:0.0:1788448640.333777:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:0.0:1788448640.333786:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+15:15656:x1875323801183232:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448640.333850:0:19479:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448640.333876:0:19479:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b804ff1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b25 expref: 15 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.333937:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.333943:0:19479:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448640.333973:0:19479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.333986:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.333995:0:19479:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448640.334125:0:19479:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e65e04fd reply state 000000001765d505 transno 8589934616 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.334137:0:19479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f800/0xf45a9e4e6b804fff lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19479 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.334143:0:19479:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.334152:0:19479:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788448640.334155:0:19479:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448640.334253:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+16:15656:x1875323801183232:12345-192.168.206.21@tcp:36:lhsmtool_posix.0 Request processed in 468us (763us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788448640.335651:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:3.0:1788448640.342422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.342819:0:19178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801183360 00000100:00100000:1.0:1788448640.342831:0:19178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801183360 00000100:00100000:1.0:1788448640.342924:0:19178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:1.0:1788448640.342934:0:19178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+7:15656:x1875323801183360:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448640.342953:0:19178:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448640.342973:0:19178:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b33 expref: -99 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.343009:0:19178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.343019:0:19178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.343023:0:19178:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.343028:0:19178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 8 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.343086:0:19178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.343111:0:19178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.343127:0:19178:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19178:1875323826429312:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448640.343208:0:19178:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc0824209c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448640.347965:0:19178:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19178:1875323826429312:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448640.348002:0:19178:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 8 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.348022:0:19178:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc0824fdc00, rc 0) 00000100:00100000:3.0:1788448640.348199:0:19178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+8:15656:x1875323801183360:12345-192.168.206.21@tcp:101:lhsmtool_posix.0 Request processed in 5264us (5785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448640.348224:0:19178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:2.0:1788448640.353653:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.357641:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801183488 00000100:00100000:1.0:1788448640.357654:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801183488 00010000:00010000:1.0:1788448640.357709:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.357741:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:1.0:1788448640.357751:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+8:2398:x1875323801183488:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448640.357764:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448640.357784:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.357798:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.357819:0:17132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4157210/0xf45a9e4e6b804ff8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b2c expref: 8 pid: 18650 timeout: 657 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.357855:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.357861:0:17132:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.357867:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 7 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.357877:0:17132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 7 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.358169:0:17132:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 7 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.358184:0:17132:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17132:1875323826429440:192.168.206.21@tcp:105: 00000100:00100000:1.0:1788448640.358396:0:17132:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448640.364523:0:17132:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:17132:1875323826429440:192.168.206.21@tcp:105: 00010000:00010000:1.0:1788448640.364553:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448640.364624:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2398:x1875323801183488:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 6866us (10974us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448640.364636:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788448640.395270:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.395343:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801183616 00000100:00100000:0.0:1788448640.395363:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801183616 00000100:00100000:0.0:1788448640.395432:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1788448640.395443:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2398:x1875323801183616:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788448640.395592:0:18652:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788448640.395595:0:18652:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788448638 00002000:00010000:0.0:1788448640.395598:0:18652:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788448637 00002000:00010000:0.0:1788448640.395600:0:18652:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788448640 -> 1788448638 00002000:00010000:0.0:1788448640.395602:0:18652:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788448640.395681:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+8:2398:x1875323801183616:12345-192.168.206.21@tcp:2:lhsmtool_posix.0 Request processed in 238us (503us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788448640.395688:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:2.0:1788448640.410150:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.410306:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801183744 00000100:00100000:1.0:1788448640.410319:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801183744 00000100:00100000:1.0:1788448640.410395:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:1.0:1788448640.410407:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+8:2399:x1875323801183744:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788448640.410470:0:18650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.410513:0:18650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 8 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.410522:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.410528:0:18650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448640.410533:0:18650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.410569:0:18650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 8 pid: 19178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.410585:0:18650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 8 pid: 19178 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.410601:0:18650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18650:1875323826429568:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788448640.411009:0:18650:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc082420780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448640.414721:0:18650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:18650:1875323826429568:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788448640.414750:0:18650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448640.418237:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448640.419441:0:17131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801183872 00000100:00100000:3.0:1788448640.419457:0:17131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801183872 00010000:00010000:3.0:1788448640.419511:0:17131:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 9 pid: 19178 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448640.419599:0:17131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:3.0:1788448640.419610:0:17131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+9:2398:x1875323801183872:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448640.419626:0:17131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448640.419649:0:17131:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 9 pid: 19178 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.419665:0:17131:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 9 pid: 19178 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.419711:0:17131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d699b24/0xf45a9e4e6b805006 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b33 expref: 9 pid: 19178 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.419730:0:17131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448640.419734:0:17131:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448640.419741:0:17131:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.419750:0:17131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.419793:0:17131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448640.419858:0:17131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+8:2398:x1875323801183872:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 249us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448640.419866:0:17131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00010000:00010000:0.0:1788448640.419971:0:18650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.419981:0:18650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420000:0:18650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420009:0:18650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420036:0:18650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420042:0:18650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fc400 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448640.420046:0:18650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420054:0:18650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420067:0:18650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.420075:0:18650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f0cf126/0xf45a9e4e6b80500d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.420147:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2399:x1875323801183744:12345-192.168.206.21@tcp:1:lhsmtool_posix.0 Request processed in 9741us (10010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.420154:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:3.0:1788448640.429719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.429829:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801184128 00000100:00100000:2.0:1788448640.429840:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801184128 00000100:00100000:2.0:1788448640.429965:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:2.0:1788448640.429980:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+16:15656:x1875323801184128:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788448640.430076:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.430471:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 16 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.430482:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.430538:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 16 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.430553:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 16 pid: 19479 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448640.430569:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083f1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826429696:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788448640.430656:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1908609c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448640.436671:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.437203:0:20175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801184256 00000100:00100000:1.0:1788448640.437226:0:20175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801184256 00010000:00010000:1.0:1788448640.437289:0:20175:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 17 pid: 19479 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.437504:0:20175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:1.0:1788448640.437516:0:20175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+17:2399:x1875323801184256:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448640.437535:0:20175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448640.437544:0:20175:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 17 pid: 19479 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.437557:0:20175:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 17 pid: 19479 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.437581:0:20175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:1.0:1788448640.437587:0:20175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 17 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.437596:0:20175:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.437603:0:20175:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.437610:0:20175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.437631:0:20175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448640.437693:0:20175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03254173-b90a-4634-8f44-6b5b52d8ff13+17:2399:x1875323801184256:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 178us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448640.437701:0:20175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00010000:00010000:0.0:1788448640.439794:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4000/0xf45a9e4e6b804f5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0af4 expref: 16 pid: 19479 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.439827:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083f1c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826429696:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788448640.439924:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.439954:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.439960:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.440874:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.441182:0:17146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.441192:0:17146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.441247:0:17146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 16 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.441410:0:17146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 16 pid: 17147 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.441429:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826429824:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788448640.441637:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b5d23780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448640.449097:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.449162:0:17132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801184384 00000100:00100000:1.0:1788448640.449184:0:17132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801184384 00010000:00010000:1.0:1788448640.449234:0:17132:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 17 pid: 17147 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.449289:0:17132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:1.0:1788448640.449299:0:17132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+17:2398:x1875323801184384:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448640.449315:0:17132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448640.449323:0:17132:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 17 pid: 17147 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.449348:0:17132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 17 pid: 17147 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.449374:0:17132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:1.0:1788448640.449381:0:17132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.449392:0:17132:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.449399:0:17132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.449418:0:17132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448640.449533:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b800/0xf45a9e4e6b804fe3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b1e expref: 17 pid: 17147 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448640.449553:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08201ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826429824:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788448640.449578:0:17146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.449588:0:17146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.449606:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448640.449736:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788448640.449874:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000001:00080000:3.0:1788448640.449955:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788448640.450042:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17146:1875323826429952:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788448640.450096:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448640.450131:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1b0391900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448640.451027:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826429952 00000100:00100000:3.0:1788448640.451040:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826429952 00000100:00100000:3.0:1788448640.451116:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448640.451126:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17146:x1875323826429952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788448640.451244:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17146:x1875323826429952:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448640.451262:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448640.451308:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17146:1875323826429952:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788448640.451528:0:17146:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934620 00000100:00100000:3.0:1788448640.451590:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17146:1875323826430080:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788448640.451625:0:17146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448640.451649:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430080 00000100:00100000:3.0:1788448640.451653:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430080 00000100:00100000:3.0:1788448640.451672:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448640.451678:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17146:x1875323826430080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788448640.451772:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17146:x1875323826430080:12345-0@lo:1000:mdt00_001.0 Request processed in 94us (146us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788448640.451789:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448640.451807:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc083764cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448640.451824:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17146:1875323826430080:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788448640.451859:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451869:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451877:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451906:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1fc00 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448640.451911:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451920:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451936:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:3.0:1788448640.451939:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448640.451944:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451950:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1fc00/0xf45a9e4e6b80501b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451981:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.451988:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452001:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452006:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fd000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:3.0:1788448640.452009:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452016:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452025:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:3.0:1788448640.452027:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448640.452035:0:17146:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 20 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452046:0:17146:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 20 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452055:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 20 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.452101:0:17146:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1c204b400/0xf45a9e4e6b804f7a lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b02 expref: 20 pid: 19479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448640.452112:0:17146:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826430208:192.168.206.21@tcp:105: 00000100:00100000:1.0:1788448640.453108:0:17132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+20:2398:x1875323801184384:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 3789us (4004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448640.453123:0:17132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:3.0:1788448640.453461:0:17146:0:(client.c:2715:ptlrpc_set_wait()) set ffff9fc1863d36c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448640.457608:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.458145:0:17148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801184512 00000100:00100000:1.0:1788448640.458156:0:17148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801184512 00000100:00100000:1.0:1788448640.458425:0:17148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:1.0:1788448640.458439:0:17148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bb718c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+20:15655:x1875323801184512:12345-192.168.206.21@tcp:49:dd.0 00000100:00100000:0.0:1788448640.458495:0:17146:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17146:1875323826430208:192.168.206.21@tcp:105: 00010000:00010000:0.0:1788448640.458521:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.458531:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc0824fd000/0xf45a9e4e6b804f73 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.458569:0:17146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.458584:0:17146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.458587:0:17148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bb718c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+20:15655:x1875323801184512:12345-192.168.206.21@tcp:49:dd.0 Request processed in 152us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448640.458594:0:17148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00010000:00010000:0.0:1788448640.458595:0:17146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.458604:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.458610:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.458616:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459775:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc182c1f400 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448640.459782:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459792:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459811:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448640.459813:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448640.459817:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459824:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc182c1f400/0xf45a9e4e6b805022 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459858:0:17146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459865:0:17146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459871:0:17146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459875:0:17146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1871e5000 already unused, calling callback (ffffffffc17794f0) 00010000:00010000:0.0:1788448640.459878:0:17146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459900:0:17146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459908:0:17146:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:0.0:1788448640.459911:0:17146:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448640.459914:0:17146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.459920:0:17146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5000/0xf45a9e4e6b805014 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17146 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.460129:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+19:15656:x1875323801184128:12345-192.168.206.21@tcp:57:lhsmtool_posix.0 Request processed in 30148us (30413us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788448640.460140:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00000020:00080000:0.0:1788448640.460146:0:17146:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788448640.461274:0:17181:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788448640.461283:0:17181:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448640.461303:0:17181:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788448640.461308:0:17181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788448640.468066:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.468182:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801184640 00000100:00100000:2.0:1788448640.468194:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801184640 00000100:00100000:2.0:1788448640.468293:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:2.0:1788448640.468306:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+19:15655:x1875323801184640:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788448640.468331:0:17145:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448640.468366:0:17145:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b805029 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x369877a40d7e0b3a expref: -99 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.468404:0:17145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b805030 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.468418:0:17145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b805030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.468434:0:17145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b805030 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17145 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.468587:0:17145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e4400/0xf45a9e4e6b805029 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b3a expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448640.468607:0:17145:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1871e5400/0xf45a9e4e6b805030 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0x369877a40d7e0b3a expref: 20 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448640.468790:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448640.469200:0:17149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801184896 00000100:00100000:3.0:1788448640.469207:0:17149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801184896 00000100:00100000:3.0:1788448640.469485:0:17149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:3.0:1788448640.469499:0:17149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+21:15656:x1875323801184896:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788448640.469748:0:17149:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788448640.469782:0:17149:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934622 00010000:00010000:3.0:1788448640.469823:0:17149:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.469836:0:17149:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.469845:0:17149:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.469852:0:17149:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.469858:0:17149:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.469864:0:17149:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.469878:0:17149:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448640.469895:0:17134:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448640.469909:0:17134:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.469915:0:17134:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9000 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448640.469919:0:17134:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.469927:0:17134:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.469940:0:17134:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9fc185378900) 00010000:00010000:0.0:1788448640.469943:0:17134:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448640.469947:0:17134:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.469952:0:17134:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9fc1bb4a9000/0xf45a9e4e6b805037 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17149 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.469962:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448640.469963:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448640.469965:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448640.469998:0:17149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:03254173-b90a-4634-8f44-6b5b52d8ff13+23:15656:x1875323801184896:12345-192.168.206.21@tcp:35:lhsmtool_posix.0 Request processed in 503us (1208us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788448640.470006:0:17149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000020:00080000:3.0:1788448640.470011:0:17149:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448640.470180:0:17145:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9fc08319bc00) 00010000:00010000:2.0:1788448640.470183:0:17145:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788448640.470186:0:17145:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9fc1871e5400, rc 0) 00000100:00100000:2.0:1788448640.470238:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+22:15655:x1875323801184640:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1935us (4626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448640.470245:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00010000:00010000:0.0:1788448640.702380:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448640.710681:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788448640.710826:0:18655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185024 00000100:00100000:3.0:1788448640.710837:0:18655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185024 00000100:00100000:3.0:1788448640.711063:0:18655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 0 00000100:00100000:3.0:1788448640.711075:0:18655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2401:x1875323801185024:12345-192.168.206.21@tcp:4:dd.0 00002000:00010000:3.0:1788448640.711135:0:18655:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a998f7e, atime: 0x6a998f7d, ctime: 0x6a998f7e, blocks: 0x0 00010000:00010000:3.0:1788448640.711143:0:18655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.711159:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=558s v=(0 0) 00010000:00010000:3.0:1788448640.711164:0:18655:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448640.711170:0:18655:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448640.711186:0:18655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.729596:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788448640.729680:0:18657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788448640.729690:0:18657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788448640.730009:0:18657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185152 00000100:00100000:2.0:1788448640.730019:0:18657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185152 00000100:00100000:1.0:1788448640.731285:0:20289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00100000:1.0:1788448640.731301:0:20289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+8:2400:x1875323801185152:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:1.0:1788448640.731337:0:20289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.731356:0:20289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.731360:0:20289:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448640.731367:0:20289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.731381:0:20289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448640.853144:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788448640.853174:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1788448640.856270:0:18655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:0.0:1788448640.856281:0:18655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788448638 -> 1788448640 00002000:00010000:0.0:1788448640.856284:0:18655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788448638 -> 1788448640 00002000:00010000:0.0:1788448640.856286:0:18655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 14952 00010000:00010000:0.0:1788448640.856304:0:18655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.856318:0:18655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.856347:0:18655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.856353:0:18655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc1bb4a9800 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:0.0:1788448640.856358:0:18655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.856365:0:18655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.856391:0:18655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448640.856398:0:18655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b903370d/0xf45a9e4e6b80503e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.856505:0:18655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+7:2401:x1875323801185024:12345-192.168.206.21@tcp:4:dd.0 Request processed in 145427us (145828us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788448640.856520:0:18655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 0 00000001:00080000:2.0:1788448640.870413:0:18646:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:1.0:1788448640.871189:0:20289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.871241:0:20289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.871249:0:20289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.871266:0:20289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9fc0824fda00 already unused, calling callback (ffffffffc0b4c230) 00010000:00010000:1.0:1788448640.871271:0:20289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.871282:0:20289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.871302:0:20289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448640.871311:0:20289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063e262b5/0xf45a9e4e6b805045 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448640.871741:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.871781:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.871822:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.871849:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.871868:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.871926:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185920 00000100:00100000:0.0:1788448640.871937:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185920 00000100:00100000:0.0:1788448640.872001:0:18652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185536 00000100:00100000:0.0:1788448640.872004:0:18652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185536 00000100:00100000:0.0:1788448640.872027:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1788448640.872037:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801185920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448640.872100:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2400:x1875323801185920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.872108:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:0.0:1788448640.872124:0:18652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:0.0:1788448640.872131:0:18652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801185536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448640.872156:0:18652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082019f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2401:x1875323801185536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.872163:0:18652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00080000:0.0:1788448640.872179:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448640.872183:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448640.872206:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788448640.872239:0:20289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801185152:12345-192.168.206.21@tcp:4:dd.0 Request processed in 140942us (142653us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788448640.872240:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185408 00000100:00100000:0.0:1788448640.872243:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185408 00000100:00100000:1.0:1788448640.872247:0:20289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1 00000100:00080000:0.0:1788448640.872257:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448640.872282:0:19479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185664 00000100:00100000:0.0:1788448640.872285:0:19479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185664 00000100:00080000:0.0:1788448640.872312:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448640.872320:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185792 00000100:00100000:0.0:1788448640.872323:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185792 00000100:00080000:0.0:1788448640.872335:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788448640.872352:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:0.0:1788448640.872358:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc08201a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801185408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448640.872385:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc08201a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:03254173-b90a-4634-8f44-6b5b52d8ff13+5:2400:x1875323801185408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.872402:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:0.0:1788448640.872415:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1788448640.872421:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801185792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448640.872446:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801185792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.872452:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:0.0:1788448640.872480:0:19479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1788448640.872486:0:19479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc082018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801185664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448640.872516:0:19479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc082018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+6:2400:x1875323801185664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.872522:0:19479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:3.0:1788448640.872606:0:17140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801185280 00000100:00100000:3.0:1788448640.872611:0:17140:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801185280 00000100:00100000:3.0:1788448640.872646:0:17140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:3.0:1788448640.872653:0:17140:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2401:x1875323801185280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788448640.872681:0:17140:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b9a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:712f63d1-2d07-4fc2-9551-3a10ea985aa1+13:2401:x1875323801185280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448640.872687:0:17140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 167 00000100:00100000:1.0:1788448640.872877:0:3640:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788448640.873348:0:18650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323801186048 00000100:00100000:0.0:1788448640.873358:0:18650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323801186048 00000100:00100000:0.0:1788448640.873461:0:18650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:0.0:1788448640.873469:0:18650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801186048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788448640.873520:0:18650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ce2a7bf3-0136-4a94-abb6-f1a63ca661e8+5:2401:x1875323801186048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 52us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448640.873526:0:18650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00080000:1.0:1788448640.873569:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448641.214485:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448641.214509:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826430336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788448641.214596:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.214687:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430336 00000100:00100000:3.0:1788448641.214695:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430336 00000100:00100000:3.0:1788448641.214744:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788448641.214755:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826430336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788448641.214790:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788448641.214839:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826430336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.214858:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448641.214959:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826430336:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788448641.216416:0:17898:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448641.216954:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448641.216976:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826430464:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788448641.217047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.218839:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430464 00000100:00100000:3.0:1788448641.218852:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430464 00000100:00100000:3.0:1788448641.218940:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788448641.218951:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826430464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788448641.218985:0:17150:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788448641.219075:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875323826430464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 124us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.219082:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788448641.219328:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875323826430464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788448641.726480:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826430592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448641.726557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.726702:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826430720:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788448641.726736:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.726811:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430592 00000100:00100000:3.0:1788448641.726820:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430592 00000100:00100000:3.0:1788448641.726874:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430720 00000100:00100000:3.0:1788448641.726877:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430720 00000100:00100000:3.0:1788448641.726919:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448641.726928:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc083ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826430592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448641.726962:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1788448641.727002:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc083ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826430592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.727008:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448641.727024:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448641.727030:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bff48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826430720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788448641.727038:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:3.0:1788448641.727063:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bff48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875323826430720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.727068:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788448641.727139:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448641.727165:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788448641.727169:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9fc1bf7c8380, transno 8589934596 00000004:00080000:1.0:1788448641.727185:0:3645:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788448641.727225:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826430592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448641.727385:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875323826430720:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788448641.727387:0:17133:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448642.405589:0:20326:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788448642.750966:0:17134:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448643.262279:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448643.262315:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bfed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826430848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448643.262395:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448643.262522:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1bff49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826430976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448643.262550:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448643.264399:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430848 00000100:00100000:0.0:1788448643.264414:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430848 00000100:00100000:0.0:1788448643.264477:0:18654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826430976 00000100:00100000:0.0:1788448643.264480:0:18654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826430976 00000100:00100000:0.0:1788448643.264501:0:18654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448643.264510:0:18654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826430848:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788448643.264986:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448643.265014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826431104:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.265301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.265353:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826431616:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.265386:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.265411:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826432128:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.265441:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.265473:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788448643.265480:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826431232:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.265510:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.265945:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826431744:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.265978:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.266002:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826432256:0@lo:400:kworker.0 00000100:00100000:3.0:1788448643.266261:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826431488:0@lo:400:kworker.0 00000100:00100000:3.0:1788448643.266358:0:18653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448643.266374:0:18653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc1bfed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826430976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448643.266396:0:18653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788448643.266453:0:18653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826430976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (3901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448643.266460:0:18653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448643.266493:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431616 00000100:00100000:3.0:1788448643.266501:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431616 00000100:00100000:1.0:1788448643.266784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.266877:0:17139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431104 00000100:00100000:1.0:1788448643.266909:0:17139:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431104 00000100:00100000:1.0:1788448643.266995:0:17139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788448643.267005:0:17139:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc187b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3645:x1875323826431104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.267184:0:17139:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc187b98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:943bfcb5-816e-4cdd-a66b-4e69884ef502+24:3645:x1875323826431104:12345-0@lo:400:kworker.0 Request processed in 181us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.267208:0:17139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788448643.267249:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431232 00000100:00100000:1.0:1788448643.267254:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431232 00000100:00100000:1.0:1788448643.267276:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448643.267282:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826431232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.267320:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875323826431232:12345-0@lo:400:kworker.0 Request processed in 37us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.267326:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448643.267348:0:18651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431744 00000100:00100000:1.0:1788448643.267351:0:18651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431744 00000100:00100000:1.0:1788448643.267392:0:18651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448643.267399:0:18651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826431744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.267432:0:18651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826431744:12345-0@lo:400:kworker.0 Request processed in 33us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.267438:0:18651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448643.267457:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432128 00000100:00100000:1.0:1788448643.267462:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432128 00000100:00100000:1.0:1788448643.267492:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432256 00000100:00100000:1.0:1788448643.267495:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432256 00000100:00100000:1.0:1788448643.267522:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448643.267528:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826432128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.267560:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875323826432128:12345-0@lo:400:kworker.0 Request processed in 32us (2118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.267566:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448643.267577:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448643.267582:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826432256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.267620:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875323826432256:12345-0@lo:400:kworker.0 Request processed in 37us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.267626:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788448643.267643:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448643.267647:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788448643.267650:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448643.267686:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc19137d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875323826431232:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.268247:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826431744:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.268267:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875323826432256:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.268277:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083ff5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:943bfcb5-816e-4cdd-a66b-4e69884ef502:3645:1875323826431104:0@lo:400:kworker.0 00010000:00080000:1.0:1788448643.268293:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc0834f7b80 x1875323826432128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448643.268304:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc0834f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875323826432128:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.268530:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.268576:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826432000:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.268623:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.268664:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bff49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826430976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448643.268685:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788448643.268693:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc083e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826431360:0@lo:400:kworker.0 00000100:00100000:2.0:1788448643.269748:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431488 00000100:00100000:2.0:1788448643.269763:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431488 00000100:00100000:2.0:1788448643.269846:0:17147:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432000 00000100:00100000:2.0:1788448643.269868:0:17147:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432000 00000100:00100000:1.0:1788448643.270003:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.270124:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826431872:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.270155:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.270171:0:3648:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9fc18394ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.270222:0:3648:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448643.270255:0:17146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431872 00000100:00100000:1.0:1788448643.270259:0:17146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431872 00002000:00000024:0.0:1788448643.270349:0:18654:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788448643.270489:0:18654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc1bfed4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875323826430848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 5976us (8090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448643.270501:0:18654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448643.270610:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1bfed5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875323826430848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788448643.271392:0:19177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826431360 00000100:00100000:3.0:1788448643.271401:0:19177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826431360 00000100:00100000:3.0:1788448643.271462:0:19177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788448643.271472:0:19177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826431360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448643.271544:0:19177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3648:x1875323826431360:12345-0@lo:400:kworker.0 Request processed in 74us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448643.271551:0:19177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448643.271693:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323826432384 00000100:00100000:0.0:1788448643.271698:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323826432384 00000100:00100000:0.0:1788448643.271728:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00080000:3.0:1788448643.272313:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788448643.272320:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448643.272365:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788448643.272623:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448643.272640:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826432384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448643.272729:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875323826432384:12345-0@lo:400:kworker.0 Request processed in 96us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448643.272736:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788448643.272756:0:17147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448643.275230:0:17146:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788448643.275253:0:17146:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788448643.275385:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083e21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875323826431360:0@lo:400:kworker.0 00010000:00080000:1.0:1788448643.275413:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9fc18394ed80 x1875323826432384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448643.275428:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc18394ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875323826432384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.275604:0:17146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448643.275615:0:17146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826431872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448643.276976:0:17146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875323826431872:12345-0@lo:400:kworker.0 Request processed in 1351us (6807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.276991:0:17146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448643.277265:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875323826431872:0@lo:400:kworker.0 00000100:00100000:0.0:1788448643.277918:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826431488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448643.278279:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826431616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448643.278424:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875323826431616:12345-0@lo:400:kworker.0 Request processed in 6051us (13036us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448643.278435:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448643.278508:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc08341c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875323826431616:0@lo:400:kworker.0 00000100:00080000:3.0:1788448643.278536:0:17141:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448643.279648:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3648:x1875323826431488:12345-0@lo:400:kworker.0 Request processed in 7894us (11110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448643.279663:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448643.279980:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc1ba1f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3648:1875323826431488:0@lo:400:kworker.0 00000100:00100000:2.0:1788448643.291080:0:17147:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9fc18394df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826432000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448643.291254:0:17147:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9fc18394df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875323826432000:12345-0@lo:400:kworker.0 Request processed in 18490us (22629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448643.291269:0:17147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448643.291341:0:3648:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9fc083689500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875323826432000:0@lo:400:kworker.0 00010000:00010000:0.0:1788448643.774181:0:19726:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 43337 lines, 43337 kept, 0 dropped, 0 bad.